CN117793545A - Image acquisition method, device, electronic equipment and storage medium - Google Patents
Image acquisition method, device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN117793545A CN117793545A CN202311839933.5A CN202311839933A CN117793545A CN 117793545 A CN117793545 A CN 117793545A CN 202311839933 A CN202311839933 A CN 202311839933A CN 117793545 A CN117793545 A CN 117793545A
- Authority
- CN
- China
- Prior art keywords
- image data
- line
- line image
- photosensitive
- different
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 68
- 238000003860 storage Methods 0.000 title claims abstract description 19
- 238000012545 processing Methods 0.000 claims abstract description 71
- 230000010354 integration Effects 0.000 claims abstract description 57
- 238000007781 pre-processing Methods 0.000 claims abstract description 37
- 238000012937 correction Methods 0.000 claims abstract description 32
- 238000004590 computer program Methods 0.000 claims description 12
- 238000013461 design Methods 0.000 abstract description 9
- 230000017525 heat dissipation Effects 0.000 abstract description 9
- 230000008569 process Effects 0.000 description 17
- 230000007547 defect Effects 0.000 description 9
- 238000004891 communication Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- 230000000694 effects Effects 0.000 description 5
- 238000001514 detection method Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 3
- 230000003190 augmentative effect Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000009776 industrial production Methods 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 238000009825 accumulation Methods 0.000 description 1
- 230000003139 buffering effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000007687 exposure technique Methods 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000004904 shortening Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Landscapes
- Studio Devices (AREA)
Abstract
The application discloses an image acquisition method, an image acquisition device, electronic equipment and a storage medium, and belongs to the technical field of image processing. The method comprises the following steps: acquiring multi-line image data obtained by exposing different light sensing lines in an image sensor in different time periods; the image sensor at least comprises two photosensitive lines, and each photosensitive line corresponds to one line of image data; preprocessing multi-line image data; the preprocessing comprises the steps of carrying out space correction on the multi-line image data so that the multi-line image data is shot at the same position on a target object, and adopting different levels of brightness adjustment on different line image data; and superposing the preprocessed multi-line image data through time delay integration to obtain target image data. The image sensor with a plurality of light sensing lines is used for collecting images, TDI processing is carried out, the problem that the light source is high in design and heat dissipation requirements due to collection of bright field images in the prior art is avoided, and the cost of image collection is reduced.
Description
Technical Field
The application belongs to the technical field of image processing, and particularly relates to an image acquisition method, an image acquisition device, electronic equipment and a storage medium.
Background
In an industrial detection scene, for a scene with a relatively large dynamic range, defects of dark parts and bright parts need to be detected at the same time, and if only a traditional image acquisition method is adopted, the situation that the defects of the dark parts or the bright parts cannot be detected may occur.
The technical scheme of time-sharing exposure is that a camera is matched with a light source, a dark field image and a bright field image are alternately acquired (images of more light fields can be acquired according to requirements), the dark field image is used for detecting bright defects, and the bright field image is used for detecting dark defects.
However, in general, the brightness of the light source for dark field image acquisition is not a problem, while the use of the high line frequency of the camera is maintained during the light field image acquisition, which results in shortening the exposure time of the camera (generally, the maximum exposure time of the camera is about 1/line frequency of the camera), and if the brightness requirement of the light field image is met, the brightness of the light source needs to be improved, and thus, higher requirements are put on the design, heat dissipation, and the like of the light source.
Disclosure of Invention
The present application aims to solve at least one of the technical problems existing in the prior art. Therefore, the application provides an image acquisition method, an image acquisition device, electronic equipment and a storage medium, so that the cost of image acquisition is reduced.
In a first aspect, the present application provides an image acquisition method, including:
acquiring multi-line image data obtained by exposing different light sensing lines in an image sensor in different time periods; the image sensor at least comprises two photosensitive lines, and each photosensitive line corresponds to one line of image data;
preprocessing the multi-line image data; the preprocessing comprises the steps of carrying out space correction on the multi-line image data so that the multi-line image data is shot at the same position on a target object, and adopting different levels of brightness adjustment on different line image data;
and superposing the preprocessed multi-line image data through time delay integration to obtain target image data.
According to the image acquisition method, multi-line image data obtained by exposing different light sensing lines in the image sensor in different time periods are acquired; the image sensor at least comprises two photosensitive lines, and each photosensitive line corresponds to one line of image data; preprocessing the multi-line image data; the preprocessing comprises the steps of carrying out space correction on the multi-line image data so that the multi-line image data is shot at the same position on a target object, and adopting different levels of brightness adjustment on different line image data; and superposing the preprocessed multi-line image data through time delay integration to obtain target image data. According to the embodiment of the application, the image sensor with the plurality of light sensing lines is used for collecting images in a time-sharing exposure mode, the image data corresponding to different light sensing lines are spatially corrected so that the image data are aligned on the longitudinal spatial position, brightness adjustment of different levels is adopted for the image data of different lines so as to meet the requirements of dark fields and bright fields, then the image data of different lines are combined together in a time delay integration processing mode, so that the quality and the definition of the images are improved, the requirements of the dark fields and the bright fields are met from the angle of image processing, the problem that the light source design and the heat dissipation requirements are high due to the collection of bright field images in the prior art is avoided, and the cost of image collection is reduced.
According to an embodiment of the present application, the superimposing processing is performed on the preprocessed multi-line image data through time delay integration, to obtain target image data, including:
under the condition that the exposure time corresponding to different light sensing lines is different and the exposure starting time or the exposure ending time is the same, selecting a preset number of image data from the preprocessed multi-line image data; wherein the preset number is equal to the number of stages of the time delay integration;
and performing superposition processing on the selected image data through a time delay integration summation mode to obtain bright-field image data.
This embodiment can obtain a bright-field image brighter than the original image data by acquiring image data with different exposure times and combining the image data together by time delay integration, thereby reducing blurring and noise while improving sharpness and quality of the image.
According to an embodiment of the present application, the superimposing processing is performed on the preprocessed multi-line image data through time delay integration, to obtain target image data, including:
under the conditions that the exposure time corresponding to different light sensing lines is different and the exposure start time or the exposure end time is the same, the preprocessed first line image data with the shortest exposure time is selected to carry out 1-level time delay integration processing, and dark field image data is obtained.
In this embodiment, the acquisition requirement of the dark field image can be satisfied by acquiring image data with different exposure times and processing the preprocessed line image data with the shortest exposure time by time delay integration.
According to an embodiment of the present application, the superimposing processing is performed on the preprocessed multi-line image data through time delay integration, to obtain target image data, including:
under the condition that the exposure time corresponding to different photosensitive lines is consistent, and each photosensitive line corresponds to one line of image data and comprises a small exposure time and a large exposure time, selecting a preset number of image data from the preprocessed multi-line image data; wherein the preset number is equal to the number of stages of the time delay integration;
and superposing the part corresponding to the large exposure time in the selected image data by using a time delay integral summation mode or a time delay integral average mode to obtain bright-field image data.
In the embodiment, the image data with consistent exposure time and small exposure time and large exposure time are obtained, then the large exposure parts in the plurality of image data are combined according to the number of steps of time delay integration, the image brightness can be improved through combination in a summation mode, the signal to noise ratio of the image can be improved on the basis of maintaining the original brightness through a mean mode, and the obtaining requirement of a bright field image is met.
According to an embodiment of the present application, the superimposing processing is performed on the preprocessed multi-line image data through time delay integration, to obtain target image data, including:
and superposing the part corresponding to the small exposure time in the selected image data by using a time delay integral mean mode to obtain dark field image data.
In the embodiment, the part corresponding to the small exposure time in the image data is selected for superposition processing, so that the acquisition requirement of a dark field image can be met, and the signal to noise ratio of the image can be improved on the basis of maintaining the original brightness through a mean mode.
According to one embodiment of the present application, the spatially correcting the multi-line image data so that the multi-line image data is captured at the same location on the target object includes:
under the condition that the transverse-longitudinal ratio of the multi-line image data is 1:1, storing first line image data corresponding to a photosensitive line of a target object which is shot first in a cache; the first line image data is image data corresponding to a photosensitive line except a photosensitive line which is finally shot to a target object;
under the condition that the photosensitive line which finally shoots the target object, matching target first line image data with the same position as the target object in the second line image data from the storage; the second line image data is the image data corresponding to the photosensitive line of the target object which is finally shot.
In this embodiment, by storing first line image data of a target object captured first in a buffer memory, and then when second line image data is captured of the target object, it is possible to match target first line image data of the same position as that of the target object in the second line image data from the buffer memory, thereby achieving alignment of different line image data in longitudinal spatial positions.
According to one embodiment of the present application, the spatially correcting the multi-line image data so that the multi-line image data is captured at the same location on the target object includes:
and under the condition that the transverse-longitudinal ratio of the multi-line image data is not 1:1, performing interpolation processing on the first line image data and the second line image data to obtain a non-integer-level space correction result.
In this embodiment, when the aspect ratio of the image is not 1:1, this means that the length and width of the image are not equal, which may result in the need to align data whose spatial position is deviated to a non-integer level when spatial correction is performed. In this case, the interpolation process may mathematically calculate the spatial correction results at non-integer levels to ensure accurate alignment of the data.
In a second aspect, the present application provides an image acquisition apparatus comprising:
the acquisition module is used for acquiring multi-line image data obtained by exposing different light sensing lines in the image sensor in different time periods; the image sensor at least comprises two photosensitive lines, and each photosensitive line corresponds to one line of image data;
the preprocessing module is used for preprocessing the multi-line image data; the preprocessing comprises the steps of carrying out space correction on the multi-line image data so that the multi-line image data is shot at the same position on a target object, and adopting different levels of brightness adjustment on different line image data;
and the TDI processing module is used for carrying out superposition processing on the preprocessed multi-line image data through time delay integration to obtain target image data.
According to the image acquisition device, multi-line image data obtained by exposing different light sensing lines in the image sensor in different time periods are obtained; the image sensor at least comprises two photosensitive lines, and each photosensitive line corresponds to one line of image data; preprocessing the multi-line image data; the preprocessing comprises the steps of carrying out space correction on the multi-line image data so that the multi-line image data is shot at the same position on a target object, and adopting different levels of brightness adjustment on different line image data; and superposing the preprocessed multi-line image data through time delay integration to obtain target image data. According to the embodiment of the application, the image sensor with the plurality of light sensing lines is used for collecting images in a time-sharing exposure mode, the image data corresponding to different light sensing lines are spatially corrected so that the image data are aligned on the longitudinal spatial position, brightness adjustment of different levels is adopted for the image data of different lines so as to meet the requirements of dark fields and bright fields, then the image data of different lines are combined together in a time delay integration processing mode, so that the quality and the definition of the images are improved, the requirements of the dark fields and the bright fields are met from the angle of image processing, the problem that the light source design and the heat dissipation requirements are high due to the collection of bright field images in the prior art is avoided, and the cost of image collection is reduced.
In a third aspect, the present application provides an electronic device, including a memory, a processor, and a computer program stored on the memory and executable on the processor, where the processor implements the image acquisition method according to the first aspect when executing the computer program.
In a fourth aspect, the present application provides a non-transitory computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the image acquisition method as described in the first aspect above.
In a fifth aspect, the present application provides a chip, the chip including a processor and a communication interface, where the communication interface is coupled to the processor, and the processor is configured to execute a program or instructions to implement the image capturing method according to the first aspect.
In a sixth aspect, the present application provides a computer program product comprising a computer program which, when executed by a processor, implements the image acquisition method as described in the first aspect above.
The above technical solutions in the embodiments of the present application have at least one of the following technical effects:
according to the image acquisition method, multi-line image data obtained by exposing different light sensing lines in the image sensor in different time periods are acquired; the image sensor at least comprises two photosensitive lines, and each photosensitive line corresponds to one line of image data; preprocessing the multi-line image data; the preprocessing comprises the steps of carrying out space correction on the multi-line image data so that the multi-line image data is shot at the same position on a target object, and adopting different levels of brightness adjustment on different line image data; and superposing the preprocessed multi-line image data through time delay integration to obtain target image data. According to the embodiment of the application, the image sensor with the plurality of light sensing lines is used for collecting images in a time-sharing exposure mode, the image data corresponding to different light sensing lines are spatially corrected so that the image data are aligned on the longitudinal spatial position, brightness adjustment of different levels is adopted for the image data of different lines so as to meet the requirements of dark fields and bright fields, then the image data of different lines are combined together in a time delay integration processing mode, so that the quality and the definition of the images are improved, the requirements of the dark fields and the bright fields are met from the angle of image processing, the problem that the light source design and the heat dissipation requirements are high due to the collection of bright field images in the prior art is avoided, and the cost of image collection is reduced.
Further, in some embodiments, by acquiring image data with different exposure times and combining the image data together by time delay integration, a brighter bright field image than the original image data may be obtained, thereby reducing blurring and noise while improving the sharpness and quality of the image.
Furthermore, in some embodiments, the requirement of obtaining the dark field image can be met by obtaining image data with different exposure times and processing the preprocessed line image data with the shortest exposure time through time delay integration.
Furthermore, in some embodiments, the image data with consistent exposure time and both small exposure time and large exposure time are obtained, then the large exposure portions in the plurality of image data are selected to be combined according to the number of the time delay integration stages, the image brightness can be improved by combining in a summation mode, the signal to noise ratio of the image can be improved on the basis of maintaining the original brightness in a mean mode, and the obtaining requirement of the bright field image is met.
Furthermore, in some embodiments, the overlapping processing of the portions corresponding to the small exposure time in the image data is selected to meet the requirement of obtaining the dark field image, and the signal-to-noise ratio of the image can be improved on the basis of maintaining the original brightness through the mean mode.
Still further, in some embodiments, alignment of the different line image data in longitudinal spatial locations may be achieved by storing first line image data captured first of the target object in a buffer, and then matching from the buffer to target first line image data at the same location as the target object in the second line image data as the second line image data is captured.
Still further, in some embodiments, when the aspect ratio of the image is not 1:1, meaning that the length and width of the image are not equal, this may result in the need to align data with spatial position deviations of non-integer order when spatial correction is performed. In this case, the interpolation process may mathematically calculate the spatial correction results at non-integer levels to ensure accurate alignment of the data.
Additional aspects and advantages of the application will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the application.
Drawings
The foregoing and/or additional aspects and advantages of the present application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings, in which:
Fig. 1 is a schematic flow chart of an image acquisition method provided in an embodiment of the present application;
FIG. 2 is a schematic illustration of misalignment of image data corresponding to different light sensing lines in a longitudinal spatial position according to an embodiment of the present application;
FIG. 3 is a timing diagram for different light exposure times according to an embodiment of the present application;
FIG. 4 is a timing diagram for the case where different light sensing line exposure times are consistent in an embodiment of the present application;
FIG. 5 is a schematic output diagram of the embodiment of the present application in the case where the exposure times of different sensing lines are consistent;
fig. 6 is a schematic structural diagram of an image capturing device according to an embodiment of the present application;
fig. 7 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
Technical solutions in the embodiments of the present application will be clearly described below with reference to the drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present application are within the scope of the protection of the present application.
The terms first, second and the like in the description and in the claims, are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged, as appropriate, such that embodiments of the present application may be implemented in sequences other than those illustrated or described herein, and that the objects identified by "first," "second," etc. are generally of a type and not limited to the number of objects, e.g., the first object may be one or more. Furthermore, in the description and claims, "and/or" means at least one of the connected objects, and the character "/", generally means that the associated object is an "or" relationship.
The industrial detection scene refers to a scene in which products are detected in an industrial production process. In the industrial production process, high-precision and high-speed detection is generally required to be carried out on the surface of a product so as to ensure that the quality of the product meets the requirements.
In industrial inspection scenes, there may be areas on the surface of some products where the dynamic range is relatively large, i.e. areas where the brightness difference is relatively large. In this case, the surface of the product may have defects which may be difficult to see in bright light but clearly visible in dark light, or vice versa. In this case, if only the conventional image capturing method is adopted, there may be a case where a dark portion or a bright portion defect cannot be detected.
To solve this problem, the industry has proposed a solution that uses a time-sharing exposure technique. The technology is that a dark field image and a bright field image are alternately acquired by matching a camera and a light source, then the dark field image is used for detecting the bright defects, and the bright field image is used for detecting the dark defects. In particular, the acquisition light source brightness of dark field images is not generally a problem, but the acquisition of bright field images requires maintaining high line frequency usage of the camera, which results in a shortened exposure time of the camera. In order to meet the brightness requirement of the bright field image, the brightness of the light source needs to be improved, which puts higher requirements on the design and heat dissipation of the light source.
The application considers that if the image sensor with a plurality of light sensitive lines can be adopted to collect images, and the data obtained by exposing each light sensitive line is fused to obtain better image effect, the problem that the collection of bright field images has high requirements on the design and heat dissipation of the light source in the prior art is hopefully avoided, and the cost of image collection is reduced.
The image acquisition method, the device, the electronic equipment and the storage medium provided by the embodiment of the application are described in detail below through specific embodiments and application scenes thereof with reference to the accompanying drawings.
The image acquisition method can be applied to the terminal, and can be specifically executed by hardware or software in the terminal.
The terminal includes, but is not limited to, a portable communication device such as a mobile phone or tablet having a touch sensitive surface (e.g., a touch screen display and/or a touch pad). It should also be appreciated that in some embodiments, the terminal may not be a portable communication device, but rather a desktop computer having a touch-sensitive surface (e.g., a touch screen display and/or a touch pad).
In the following various embodiments, a terminal including a display and a touch sensitive surface is described. However, it should be understood that the terminal may include one or more other physical user interface devices such as a physical keyboard, mouse, and joystick.
The execution subject of the image acquisition method provided by the embodiment of the present application may be an electronic device or a functional module or a functional entity capable of implementing the image acquisition method in the electronic device, where the electronic device mentioned in the embodiment of the present application includes, but is not limited to, a mobile phone, a tablet computer, a camera, a wearable device, and the like, and the image acquisition method provided by the embodiment of the present application is described below by taking the electronic device as an execution subject.
As shown in fig. 1, the image acquisition method includes: step 110, step 120 and step 130.
Step 110, acquiring multi-line image data obtained by exposing different light sensing lines in an image sensor in different time periods; the image sensor at least comprises two photosensitive lines, and each photosensitive line corresponds to one line of image data.
The image sensor can convert the light image on the light sensing surface into an electric signal in corresponding proportional relation with the light image by utilizing the photoelectric conversion function of the photoelectric device. In an image sensor, each photosensitive line (or detector) can obtain corresponding image data through exposure time of a camera in different time periods, and each line of image data can comprise multiple frames of images.
In the embodiment of the application, in order to meet the requirement of detecting defects of a dark portion and a bright portion simultaneously for a scene with a relatively large dynamic range in an industrial detection scene, an image sensor including two or more photosensitive lines may be used for shooting.
In the embodiment of the application, different exposure times may be set for different light sensing lines according to needs, for example, the exposure times of different light sensing lines are different, or the exposure times of different light sensing lines are the same. Under the condition that the exposure time of different light sensing lines is different, in order to meet the acquisition requirements of dark field images and bright field images and facilitate the subsequent processing of image data corresponding to the different light sensing lines, the exposure start time or the exposure end time of the different light sensing lines is the same; under the condition that the exposure time of different light sensing lines is the same, in order to meet the acquisition requirements of dark field images and bright field images and facilitate the subsequent processing of image data corresponding to the different light sensing lines, each light sensing line corresponds to a large exposure time and a small exposure time.
Step 120, preprocessing the multi-line image data; the preprocessing includes spatially correcting the multi-line image data so that the multi-line image data is captured at the same location on the target object and with different levels of brightness adjustment for different line image data.
In the present embodiment, the purpose of preprocessing the image data is to suppress unwanted distortion or enhance certain image features that are important for subsequent processing. Preprocessing methods may include pixel brightness transforms, geometric transforms, local neighborhood preprocessing, image restoration, and the like.
In order to enhance the visual effect and highlight the emphasis of the image, in the embodiment of the application, the preprocessing may be to adopt different levels of brightness adjustment for different line image data so as to meet the acquisition requirements of different brightness images. There are many methods for adjusting brightness, and the brightness adjustment can be achieved by a camera gain (digital gain or analog gain), a brightness adjustment algorithm, or a gray scale mapping method, which is not limited in this embodiment of the present application.
In the embodiment of the present application, the brightness adjustment operation on the image data may be represented by k×d, where k represents an equivalent coefficient after final brightness adjustment, and D represents the image data. For example, if a dark field image needs to be output, the image needs to be subjected to a dimming process, in which case image data having a short exposure time can be dimmed in the case where the exposure times of different light-sensitive lines are different, or in which case a small exposure portion in the image data can be dimmed in the case where the exposure times of different light-sensitive lines are the same, where k may be a number smaller than 1, in order to obtain an image darker than the minimum exposure time of the camera (or the minimum strobe time of the light source); if a brighter image is to be output, the image data with a longer exposure time may be brighter in the case of different exposure times of different light-sensitive lines, or the large exposure portion in the image data may be adjusted by an amount when k may be a number greater than 1 in the case of the same exposure time of different light-sensitive lines.
As shown in fig. 2, due to the deviation of the physical positions of the detectors corresponding to different light sensing lines, the data acquired at the same time is different positions on the target object, so that for subsequent processing, it is required to ensure that the image data corresponding to different light sensing lines are aligned in the longitudinal spatial positions, that is, the multi-line image data is taken at the same position on the target object. Thus, in the embodiment of the present application, the preprocessing may also be to spatially correct the multi-line image data so that the multi-line image data is captured at the same location on the target object. For example, the image data corresponding to different light sensing lines may be aligned, or the matching alignment may be performed according to whether the target objects captured in the image data corresponding to different light sensing lines are at the same position.
In some embodiments, spatially correcting the multiline image data so that the multiline image data is captured at the same location on the target object may include:
under the condition that the transverse-longitudinal ratio of the multi-line image data is 1:1, storing first-line image data corresponding to a photosensitive line of a target object which is shot first in a cache;
under the condition that the photosensitive line which finally shoots the target object, matching target first line image data with the same position as the target object in the second line image data from the storage; the second line image data is the image data corresponding to the photosensitive line of the last shot target object.
When the aspect ratio of the image is 1:1, this means that the length and width of the image are equal, that is, the image is square, the pixel pitch of the image is uniform, the pitch of each pixel of the image in the horizontal and vertical directions is equal, and such an image is an integer-level deviation in spatial position. Thus, spatial correction can be performed by means of buffering and matching.
In the case that the image sensor includes two light sensitive lines, the first line image data is image data obtained by photographing the light sensitive line of the target object first, and the second line image data is image data obtained by photographing the target object later. For example, assuming that a first line of light captures a target object first and a second line of light captures the target object later, image data corresponding to the first line of light may be stored in a buffer as first line image data, and since the capturing process of the image sensor is changed with time, the first line of light may be captured continuously with time, where the first line of image data is image data captured by the first line of light, and the first line of image data may include a plurality of image data. However, when the second photosensitive line shoots the target object, the image data corresponding to the second photosensitive line can be used as second line image data, the position of the target object in the second line image data is determined, however, the first line image data with the same target object position is matched from the buffer memory, and then the matched first line image data is output, so that the purpose of space correction can be realized.
In the case that the image sensor includes three or more light sensitive lines, the first line image data is data photographed by a light sensitive line other than the last light sensitive line, and the first line image data does not refer to data photographed by a certain light sensitive line, but may be data photographed by a plurality of light sensitive lines other than the light sensitive line from which the target object was last photographed; the second line image data is the image data corresponding to the photosensitive line of the last shot target object. For example, the image sensor includes three photosensitive lines Line1, line2 and Line3, where Line1 captures a target object first, then Line2 captures a target object last, then image data corresponding to Line1 and Line2 are both first Line image data, image data corresponding to Line1 and Line2 can be stored in the buffer memory as first Line image data, image data corresponding to Line3 is used as second Line image data, when Line3 captures a target object, the position of the target object in the second Line image data corresponding to Line3 can be determined first, then the first Line image data with the same target object position is matched from the buffer memory, and then the matched first Line image data is output, so that the purpose of spatial correction can be achieved. When the image sensor comprises more than three light sensitive lines, the image data corresponding to the light sensitive lines of the target object which are shot first are all stored in the buffer memory as first line light sensitive data, and when the image data corresponding to the light sensitive lines of the target object which are shot last are used as second line image data.
In this embodiment, by storing first line image data of a target object captured first in a buffer memory, and then when second line image data is captured of the target object, it is possible to match target first line image data of the same position as that of the target object in the second line image data from the buffer memory, thereby achieving alignment of different line image data in longitudinal spatial positions.
In some embodiments, spatially correcting the multiline image data so that the multiline image data is captured at the same location on the target object may include:
and under the condition that the transverse-longitudinal ratio of the multi-line image data is not 1:1, performing interpolation processing on the first line image data and the second line image data to obtain a non-integer-level space correction result.
When the aspect ratio of the image is not 1:1, which means that the length and width of the image are not equal, the pixel pitch of the image may not be uniform any more, and when spatial correction is performed, data with spatial position deviation of non-integer level needs to be aligned. In this case, if it is to be ensured that the image data taken at different points in time are aligned in longitudinal spatial positions, interpolation processing may be performed. The interpolation process may mathematically calculate a spatial correction result at a non-integer level to ensure accurate alignment of the image data.
Similarly to the case where the aspect ratio of the multi-line image data is 1:1, in the case where the image sensor includes two light sensitive lines, the first line image data is image data obtained by photographing the light sensitive line of the target object first, and the second line image data is image data obtained by photographing the target object later. In the case that the image sensor includes three or more light-sensitive lines, the first line image data is data photographed by a light-sensitive line other than the last light-sensitive line, the first line image data does not refer to data photographed by a certain light-sensitive line in particular, but may be data photographed by a plurality of light-sensitive lines other than the light-sensitive line which was last photographed by the target object; the second line image data is the image data corresponding to the photosensitive line of the last shot target object. Similar interpolation processing can be performed to obtain a non-integer-level spatial correction result no matter the number of the photosensitive lines of the image sensor is two or more.
In this embodiment, the interpolation process may estimate the values between the data points by knowing the relationship between the data points. The interpolation method may include nearest neighbor interpolation, bilinear interpolation, bicubic interpolation, etc., and the application of the interpolation method is not limited to what kind of interpolation method is used for spatial correction.
In this embodiment, when the aspect ratio of the image is not 1:1, this means that the length and width of the image are not equal, which may result in the need to align data whose spatial position is deviated to a non-integer level when spatial correction is performed. In this case, the interpolation process may mathematically calculate the spatial correction results at non-integer levels to ensure accurate alignment of the data.
And 130, superposing the preprocessed multi-line image data through time delay integration to obtain target image data.
The time delay integration (Time Delay Integration, TDI) technology is based on multiple exposure and multi-frame accumulation of the same target so as to improve the signal brightness, output higher signal-to-noise ratio signals under the condition of insufficient light exposure time, improve the condition of shooting environment to cause the signal-to-noise ratio of an image to be too low, improve the image quality and enhance the image capturing capability under the condition of low light.
Specifically, if a bright field image needs to be output, after preprocessing the image data, superposition processing can be performed on the preprocessed multi-line image data through time delay integration, so that an image brighter than the original image data is obtained. If a dark field image is to be output, the image data after preprocessing and dimming can be subjected to summation and average processing through time delay integration, so that the brightness of the image cannot be greatly changed, but the signal to noise ratio of the image can be improved.
According to the image acquisition method, multi-line image data obtained by exposing different light sensing lines in the image sensor in different time periods are acquired; the image sensor at least comprises two photosensitive lines, and each photosensitive line corresponds to one line of image data; preprocessing multi-line image data; the preprocessing comprises the steps of carrying out space correction on the multi-line image data so that the multi-line image data is shot at the same position on a target object, and adopting different levels of brightness adjustment on different line image data; and superposing the preprocessed multi-line image data through time delay integration to obtain target image data. According to the embodiment of the application, the image sensor with the plurality of light sensing lines is used for collecting images in a time-sharing exposure mode, the image data corresponding to different light sensing lines are spatially corrected so that the image data are aligned on the longitudinal spatial position, brightness adjustment of different levels is adopted for the image data of different lines so as to meet the requirements of dark fields and bright fields, then the image data of different lines are combined together in a time delay integration processing mode, so that the quality and the definition of the images are improved, the requirements of the dark fields and the bright fields are met from the angle of image processing, the problem that the light source design and the heat dissipation requirements are high due to the collection of bright field images in the prior art is avoided, and the cost of image collection is reduced.
In some embodiments, the superimposing processing is performed on the preprocessed multi-line image data through time delay integration to obtain target image data, which may include:
under the condition that the exposure time corresponding to different light sensing lines is different and the exposure starting time or the exposure ending time is the same, selecting a preset number of image data from the preprocessed multi-line image data; wherein the preset number is equal to the number of stages of the time delay integration;
and performing superposition processing on the selected image data through a time delay integration summation mode to obtain bright-field image data.
Under the conditions that the exposure time corresponding to different light sensing lines is different and the exposure start time or the exposure end time is the same, the preprocessed first line image data with the shortest exposure time is selected to carry out 1-level time delay integration processing, and dark field image data is obtained.
In this embodiment, each light sensing line may correspond to an exposure time, and an image sensor including two light sensing lines is described herein as an example. As shown in fig. 3, the high level duration of line1_exp represents the exposure time of the first photosensitive Line, although the exposure time may be a low level duration depending on whether the active level is high or low, and the high level duration of line2_exp represents the exposure time of the second photosensitive Line, and the exposure end times of the two photosensitive lines are aligned, or the exposure start times are aligned, depending on the image sensor, and the two exposure lines are respectively exposed to obtain data1 and data2, which are denoted by D1 and D2.
And then preprocessing the D1 and the D2, and performing space correction and brightness adjustment. For the image data D1 corresponding to the first photosensitive line with short exposure time, the data after brightness adjustment is k0×d1, k0 may be a number smaller than 1, so as to obtain an image darker than the minimum exposure time (or minimum strobe time of the light source) of the camera, and then performing 1-level TDI processing on the image data, so as to obtain an output1 of the dark field image as k0×d1. For the image data D2 corresponding to the second photosensitive line with long exposure time, the data after brightness adjustment is k2×d2, and 1-level TDI processing can be performed on the image data, so that the output of bright-field image data is k2×d2. Of course, in order to improve the quality of the output image, a higher level TDI process may be performed on k2×d2, for example, two photosensitive lines are included in this example, a 2 level TDI process may be performed on k2×d2, in this case, in addition to brightness adjustment is performed on the image data D2 corresponding to the second photosensitive line to obtain k2×d2, brightness adjustment may also be performed on the image data D1 corresponding to the first photosensitive line to obtain k1×d1, a bright-field image obtained by output2 after TDI processing is k1×d1+k2×d2, when both k1 and k2 are greater than 1, an image brighter than the original D2 data may be obtained, and when k1=1 and k2=1, the brightness of the image may be improved without reducing the signal-to-noise ratio of the image.
Of course, the processing mode is the same for an image sensor containing more light sensing rays, but the TDI level may be higher, and two or more light field image data may be combined arbitrarily. The same applies to color cameras, and the R component, G component and B component of the camera are collected and processed respectively. In addition, the order of spatial correction and brightness adjustment may be interchanged without affecting the final data result.
According to the embodiment, the image data with different exposure time are obtained, and the image data are combined together through time delay integration, so that a bright field image which is brighter than the original image data can be obtained, the blurring and noise are reduced, meanwhile, the definition and quality of the image are improved, the preprocessed first line image data with the shortest exposure time are processed through time delay integration, and the obtaining requirement of a dark field image can be met.
In some embodiments, the superimposing processing is performed on the preprocessed multi-line image data through time delay integration to obtain target image data, including:
under the condition that the exposure time corresponding to different photosensitive lines is consistent, and each photosensitive line corresponds to one line of image data and comprises a small exposure time and a large exposure time, selecting a preset number of image data from the preprocessed multi-line image data; wherein the preset number is equal to the number of stages of the time delay integration;
And superposing the part corresponding to the large exposure time in the selected image data by using a time delay integral summation mode or a time delay integral average mode to obtain bright-field image data.
And superposing the part corresponding to the small exposure time in the selected image data by using a time delay integral mean mode to obtain dark field image data.
In this embodiment, exposure times corresponding to different light sensing lines are identical, and an image sensor including two light sensing lines is described herein as an example. As shown in fig. 4, the exposure time of the two light-sensitive lines is consistent, and different light-field images are obtained by respectively performing different exposures in the time domain. The high-level duration time of the Line1_Exp and the Line2_Exp are respectively small exposure time and large exposure time, or the high-level duration time of the Line1_Exp and the Line2_Exp can be respectively the small exposure time and the large exposure time, or the large exposure time and the small exposure time can be performed firstly, and no clear requirement exists, so long as the light source is matched, dark field image data D1 corresponding to the small exposure time and bright field image data D2 corresponding to the large exposure time can be respectively obtained, wherein the dark field image data corresponding to the first photosensitive Line is D1-1, the bright field image data corresponding to the first photosensitive Line is D2-1, the dark field image data corresponding to the second photosensitive Line is D1-2, and the bright field image data corresponding to the second photosensitive Line is D2-2.
And then preprocessing the D1 and the D2, and performing space correction and brightness adjustment. For dark field image data, the brightness-adjusted data may be k0×d1_1, k0×d1_2, k0 may be a number smaller than 1, and 1-level TDI processing may be performed on any image data corresponding to any one of the two photosensitive lines, for example, k0×d1_1 is taken to perform 1-level TDI processing, so that output1 of the dark field image is k0×d1_1, k0×d1_2 is taken to perform 1-level TDI processing, and output1 of the dark field image is obtained as k0×d1_2. Of course, the TDI mean mode may also be performed to perform superposition processing, that is, summation average processing is performed on dark field image data of multiple photosensitive lines to obtain output1 of dark field image as k0 (d1_1+d1_2)/2, so that although brightness of the image does not change greatly, signal-to-noise ratio of the image can be improved, summation average is performed on N photosensitive lines, and signal-to-noise ratio of the image can be improved approximatelyMultiple times.
For bright field image data, the brightness-adjusted data is k1×d1_1 and k2×d1_2, and the image data can be subjected to 1-level TDI processing, so that the output2 of the bright field image is k1×d1_1 or k2×d1_2. Of course, in order to improve the quality of the output image, higher-level TDI processing may be performed, for example, in this example, two photosensitive lines are included, and then 2-level TDI processing may be performed, in this case, the bright-field image data of different photosensitive lines may be subjected to superposition processing by using a TDI summation mode, so that output2 of the bright-field image data is k1×d1+k2×d1_2, and the image brightness may be improved by using the TDI summation mode processing; the bright field image data of different light sensing rays can be subjected to superposition processing through a TDI (time delay and integration) average mode, so that the output2 of the bright field image data is (k1+k2+D1_2)/2, and the signal to noise ratio of the image can be improved on the basis of keeping the original brightness through the TDI average mode processing. When k1 and k2 are both greater than 1, an image brighter than the original D2 data can be obtained, and when k1=1 and k2=1, the brightness of the image can be improved without reducing the signal-to-noise ratio of the image. Those skilled in the art may choose the TDI mean mode process or the TDI summation model process according to actual requirements, which is not limited in the embodiments of the present application.
Of course, on the premise of high line frequency, the exposure time of the dark field is very small, the interval between the dark field and the bright field is very small, so that the dark field image and the bright field image can be considered to have no position offset, and data superposition can be performed to further improve the brightness of the bright field image. Specifically, as shown in fig. 5, the final output of the bright field may overlap the output1 and the output2 in fig. 4, so as to obtain the output2' of the bright field image data as k3×output1+k4×output1, where when k3 and k4 are both greater than 1, an image brighter than the output2 data may be obtained.
Likewise, the processing mode is the same for an image sensor containing more light-sensitive rays, but the TDI level can be higher, and two or more light field image data can be combined arbitrarily. The same applies to color cameras, and the R component, G component and B component of the camera are collected and processed respectively. In addition, the order of spatial correction and brightness adjustment may be interchanged without affecting the final data result.
In the embodiment, the image data with consistent exposure time and small exposure time and large exposure time are obtained, then the large exposure parts in the image data are selected to be combined according to the number of steps of time delay integration, the image brightness can be improved by combining through a summation mode, the signal to noise ratio of the image can be improved on the basis of keeping the original brightness through a mean mode, the obtaining requirement of a bright field image is met, the part corresponding to the small exposure time in the image data is selected to be subjected to superposition processing, the obtaining requirement of a dark field image can be met, and the signal to noise ratio of the image can be improved on the basis of keeping the original brightness through the mean mode.
According to the image acquisition method provided by the embodiment of the application, the execution subject can be an image acquisition device. In the embodiment of the application, an image acquisition device is taken as an example to execute an image acquisition method by using the image acquisition device, and the image acquisition device provided by the embodiment of the application is described.
The embodiment of the application also provides an image acquisition device.
As shown in fig. 6, the image pickup apparatus includes:
an acquiring module 610, configured to acquire multi-line image data obtained by exposing different light sensing lines in the image sensor in different time periods; the image sensor at least comprises two photosensitive lines, and each photosensitive line corresponds to one line of image data;
a preprocessing module 620, configured to preprocess the multi-line image data; the preprocessing comprises the steps of carrying out space correction on the multi-line image data so that the multi-line image data is shot at the same position on a target object, and adopting different levels of brightness adjustment on different line image data;
the TDI processing module 630 is configured to perform superposition processing on the preprocessed multi-line image data through time delay integration, so as to obtain target image data.
According to the image acquisition device, multi-line image data obtained by exposing different light sensing lines in the image sensor in different time periods are obtained; the image sensor at least comprises two photosensitive lines, and each photosensitive line corresponds to one line of image data; preprocessing multi-line image data; the preprocessing comprises the steps of carrying out space correction on the multi-line image data so that the multi-line image data is shot at the same position on a target object, and adopting different levels of brightness adjustment on different line image data; and superposing the preprocessed multi-line image data through time delay integration to obtain target image data. According to the embodiment of the application, the image sensor with the plurality of light sensing lines is used for collecting images in a time-sharing exposure mode, the image data corresponding to different light sensing lines are spatially corrected so that the image data are aligned on the longitudinal spatial position, brightness adjustment of different levels is adopted for the image data of different lines so as to meet the requirements of dark fields and bright fields, then the image data of different lines are combined together in a time delay integration processing mode, so that the quality and the definition of the images are improved, the requirements of the dark fields and the bright fields are met from the angle of image processing, the problem that the light source design and the heat dissipation requirements are high due to the collection of bright field images in the prior art is avoided, and the cost of image collection is reduced.
In some embodiments, the preprocessing module 620 is further configured to:
under the condition that the transverse-longitudinal ratio of the multi-line image data is 1:1, storing first-line image data corresponding to a photosensitive line of a target object which is shot first in a cache; the first line image data is image data corresponding to a photosensitive line except a photosensitive line which is finally shot to a target object;
under the condition that the photosensitive line which finally shoots the target object, matching target first line image data with the same position as the target object in the second line image data from the storage; the second line image data is the image data corresponding to the photosensitive line of the last shot target object.
In some embodiments, the preprocessing module 620 is further configured to:
and under the condition that the transverse-longitudinal ratio of the multi-line image data is not 1:1, performing interpolation processing on the first line image data and the second line image data to obtain a non-integer-level space correction result.
In some embodiments, TDI processing module 630 is further to:
under the condition that the exposure time corresponding to different light sensing lines is different and the exposure starting time or the exposure ending time is the same, selecting a preset number of image data from the preprocessed multi-line image data; wherein the preset number is equal to the number of stages of the time delay integration;
And performing superposition processing on the selected image data through a time delay integration summation mode to obtain bright-field image data.
In some embodiments, TDI processing module 630 is further to:
under the conditions that the exposure time corresponding to different light sensing lines is different and the exposure start time or the exposure end time is the same, the preprocessed first line image data with the shortest exposure time is selected to carry out 1-level time delay integration processing, and dark field image data is obtained.
In some embodiments, TDI processing module 630 is further to:
under the condition that the exposure time corresponding to different photosensitive lines is consistent, and each photosensitive line corresponds to one line of image data and comprises a small exposure time and a large exposure time, selecting a preset number of image data from the preprocessed multi-line image data; wherein the preset number is equal to the number of stages of the time delay integration;
and superposing the part corresponding to the large exposure time in the selected image data by using a time delay integral summation mode or a time delay integral average mode to obtain bright-field image data.
In some embodiments, TDI processing module 630 is further to:
and superposing the part corresponding to the small exposure time in the selected image data by using a time delay integral mean mode to obtain dark field image data.
The image capturing device in the embodiment of the application may be an electronic device, or may be a component in an electronic device, for example, an integrated circuit or a chip. The electronic device may be a terminal, or may be other devices than a terminal. By way of example, the electronic device may be a mobile phone, tablet computer, notebook computer, palm computer, vehicle-mounted electronic device, mobile internet appliance (Mobile Internet Device, MID), augmented reality (augmented reality, AR)/Virtual Reality (VR) device, robot, wearable device, ultra-mobile personal computer, UMPC, netbook or personal digital assistant (personal digital assistant, PDA), etc., but may also be a server, network attached storage (Network Attached Storage, NAS), personal computer (personal computer, PC), television (TV), teller machine or self-service machine, etc., and the embodiments of the present application are not limited in particular.
The image capturing device in the embodiment of the present application may be a device having an operating system. The operating system may be a microsoft (Windows) operating system, an Android operating system, an IOS operating system, or other possible operating systems, which are not specifically limited in the embodiments of the present application.
In some embodiments, as shown in fig. 7, the embodiment of the present application further provides an electronic device 700, including a processor 701, a memory 702, and a computer program stored in the memory 702 and capable of running on the processor 701, where the program when executed by the processor 701 implements the respective processes of the above-mentioned image acquisition method embodiment, and the same technical effects can be achieved, and for avoiding repetition, a detailed description is omitted herein.
The electronic device in the embodiment of the application includes the mobile electronic device and the non-mobile electronic device.
The embodiment of the application further provides a non-transitory computer readable storage medium, on which a computer program is stored, which when executed by a processor, implements each process of the above-mentioned image acquisition method embodiment, and can achieve the same technical effects, so that repetition is avoided, and no further description is given here.
The processor is a processor in the electronic device in the above embodiment. Readable storage media include computer readable storage media such as computer readable memory ROM, random access memory RAM, magnetic or optical disks, and the like.
The embodiment of the application also provides a computer program product, which comprises a computer program, and the computer program realizes the image acquisition method when being executed by a processor.
The processor is a processor in the electronic device in the above embodiment. Readable storage media include computer readable storage media such as computer readable memory ROM, random access memory RAM, magnetic or optical disks, and the like.
The embodiment of the application further provides a chip, the chip includes a processor and a communication interface, the communication interface is coupled with the processor, the processor is used for running a program or instructions, the above processes based on the embodiment of the image acquisition method are realized, the same technical effects can be achieved, and in order to avoid repetition, the description is omitted here.
It should be understood that the chips referred to in the embodiments of the present application may also be referred to as system-on-chip chips, chip systems, or system-on-chip chips, etc.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Furthermore, it should be noted that the scope of the methods and apparatus in the embodiments of the present application is not limited to performing the functions in the order shown or discussed, but may also include performing the functions in a substantially simultaneous manner or in an opposite order depending on the functions involved, e.g., the described methods may be performed in an order different from that described, and various steps may also be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solutions of the present application may be embodied essentially or in a part contributing to the prior art in the form of a computer software product stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk), comprising several instructions for causing a terminal (which may be a mobile phone, a computer, a server, or a network device, etc.) to perform the methods described in the embodiments of the present application.
The embodiments of the present application have been described above with reference to the accompanying drawings, but the present application is not limited to the above-described embodiments, which are merely illustrative and not restrictive, and many forms may be made by those of ordinary skill in the art without departing from the spirit of the present application and the scope of the claims, which are also within the protection of the present application.
In the description of the present specification, reference to the terms "one embodiment," "some embodiments," "illustrative embodiments," "examples," "specific examples," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the present application. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiments or examples. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
While embodiments of the present application have been shown and described, it will be understood by those of ordinary skill in the art that: many changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the application, the scope of which is defined by the claims and their equivalents.
Claims (10)
1. An image acquisition method, comprising:
acquiring multi-line image data obtained by exposing different light sensing lines in an image sensor in different time periods; the image sensor at least comprises two photosensitive lines, and each photosensitive line corresponds to one line of image data;
Preprocessing the multi-line image data; the preprocessing comprises the steps of carrying out space correction on the multi-line image data so that the multi-line image data is shot at the same position on a target object, and adopting different levels of brightness adjustment on different line image data;
and superposing the preprocessed multi-line image data through time delay integration to obtain target image data.
2. The method according to claim 1, wherein the superimposing the preprocessed multi-line image data by time delay integration to obtain the target image data includes:
under the condition that the exposure time corresponding to different light sensing lines is different and the exposure starting time or the exposure ending time is the same, selecting a preset number of image data from the preprocessed multi-line image data; wherein the preset number is equal to the number of stages of the time delay integration;
and performing superposition processing on the selected image data through a time delay integration summation mode to obtain bright-field image data.
3. The method according to claim 1, wherein the superimposing the preprocessed multi-line image data by time delay integration to obtain the target image data includes:
Under the conditions that the exposure time corresponding to different light sensing lines is different and the exposure start time or the exposure end time is the same, the preprocessed first line image data with the shortest exposure time is selected to carry out 1-level time delay integration processing, and dark field image data is obtained.
4. The method according to claim 1, wherein the superimposing the preprocessed multi-line image data by time delay integration to obtain the target image data includes:
under the condition that the exposure time corresponding to different photosensitive lines is consistent, and each photosensitive line corresponds to one line of image data and comprises a small exposure time and a large exposure time, selecting a preset number of image data from the preprocessed multi-line image data; wherein the preset number is equal to the number of stages of the time delay integration;
and superposing the part corresponding to the large exposure time in the selected image data by using a time delay integral summation mode or a time delay integral average mode to obtain bright-field image data.
5. The method of claim 4, wherein the superimposing the preprocessed multi-line image data by time delay integration to obtain the target image data comprises:
And superposing the part corresponding to the small exposure time in the selected image data by using a time delay integral mean mode to obtain dark field image data.
6. The method of claim 1, wherein spatially correcting the multiline image data so that the multiline image data is captured at the same location on a target object comprises:
under the condition that the transverse-longitudinal ratio of the multi-line image data is 1:1, storing first line image data corresponding to a photosensitive line of a target object which is shot first in a cache; the first line image data is image data corresponding to a photosensitive line except a photosensitive line which is finally shot to a target object;
under the condition that the photosensitive line which finally shoots the target object, matching target first line image data with the same position as the target object in the second line image data from the storage; the second line image data is the image data corresponding to the photosensitive line of the target object which is finally shot.
7. The method of claim 1, wherein spatially correcting the multiline image data so that the multiline image data is captured at the same location on a target object comprises:
And under the condition that the transverse-longitudinal ratio of the multi-line image data is not 1:1, performing interpolation processing on the first line image data and the second line image data to obtain a non-integer-level space correction result.
8. An image acquisition device, comprising:
the acquisition module is used for acquiring multi-line image data obtained by exposing different light sensing lines in the image sensor in different time periods; the image sensor at least comprises two photosensitive lines, and each photosensitive line corresponds to one line of image data;
the preprocessing module is used for preprocessing the multi-line image data; the preprocessing comprises the steps of carrying out space correction on the multi-line image data so that the multi-line image data is shot at the same position on a target object, and adopting different levels of brightness adjustment on different line image data;
and the TDI processing module is used for carrying out superposition processing on the preprocessed multi-line image data through time delay integration to obtain target image data.
9. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the method of any of claims 1-7 when the program is executed by the processor.
10. A non-transitory computer readable storage medium, having stored thereon a computer program, which when executed by a processor, implements the method according to any of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311839933.5A CN117793545A (en) | 2023-12-28 | 2023-12-28 | Image acquisition method, device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311839933.5A CN117793545A (en) | 2023-12-28 | 2023-12-28 | Image acquisition method, device, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117793545A true CN117793545A (en) | 2024-03-29 |
Family
ID=90398110
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311839933.5A Pending CN117793545A (en) | 2023-12-28 | 2023-12-28 | Image acquisition method, device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117793545A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN118803436A (en) * | 2024-09-12 | 2024-10-18 | 合肥埃科光电科技股份有限公司 | High dynamic range image processing method, system and medium based on multi-line sensor |
-
2023
- 2023-12-28 CN CN202311839933.5A patent/CN117793545A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN118803436A (en) * | 2024-09-12 | 2024-10-18 | 合肥埃科光电科技股份有限公司 | High dynamic range image processing method, system and medium based on multi-line sensor |
| CN118803436B (en) * | 2024-09-12 | 2024-12-10 | 合肥埃科光电科技股份有限公司 | High dynamic range image processing method, system and medium based on multi-line sensor |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2020171373A1 (en) | Techniques for convolutional neural network-based multi-exposure fusion of multiple image frames and for deblurring multiple image frames | |
| JP5651118B2 (en) | Image processing apparatus and image processing method | |
| CN111028189A (en) | Image processing method, image processing device, storage medium and electronic equipment | |
| US20200084401A1 (en) | Correcting pixel defects based on defect history in an image processing pipeline | |
| US8098948B1 (en) | Method, apparatus, and system for reducing blurring in an image | |
| TWI632894B (en) | Heart rate activity detection system for dynamic image and method thereof | |
| TWI382754B (en) | Method of adjusting blurred image | |
| TWI779948B (en) | Lens dirt detection method for camera module | |
| CN114359055A (en) | Image stitching method and related device for multi-camera shooting screen body | |
| WO2017113917A1 (en) | Imaging method, imaging apparatus, and terminal | |
| JP2004222231A (en) | Image processing apparatus and image processing program | |
| CN110060625B (en) | LED display screen acquisition vignetting compensation method | |
| CN117793545A (en) | Image acquisition method, device, electronic equipment and storage medium | |
| JP2008011467A (en) | Imaging method and apparatus for display panel | |
| CN107016637B (en) | It is a kind of for improving the self adaptive imaging method of terrible imaging efficiency | |
| JP2003168103A (en) | Screen line defect detection method and apparatus, and image data correction method | |
| CN107395983B (en) | Image processing method, mobile terminal and computer readable storage medium | |
| CN112233032B (en) | A method for removing ghosts in high dynamic range images | |
| CN118488329A (en) | Pixel dead pixel correction method and device, electronic equipment and storage medium | |
| US7702176B2 (en) | One dimensional feature enhancement | |
| US20200092452A1 (en) | Image generating method and electronic apparatus | |
| CN103020915B (en) | A kind of objective image enhancement method based on video data | |
| CN115326264B (en) | Structure wave impact force non-contact measurement method and system based on machine vision | |
| JP2004222233A (en) | Image processing apparatus and image processing program | |
| JP2018160024A (en) | Image processing device, image processing method and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |