CN118338132B

CN118338132B - Shooting method and system for flexible material, storage medium and electronic equipment

Info

Publication number: CN118338132B
Application number: CN202410744214.3A
Authority: CN
Inventors: 朱文兵; 陈锦涛; 罗时帅; 钱曙光; 汪炉生; 柳洪哲; 柳云鸿; 钱根
Original assignee: Rongcheer Industrial Technology Suzhou Co ltd
Current assignee: Rongcheer Industrial Technology Suzhou Co ltd
Priority date: 2024-06-11
Filing date: 2024-06-11
Publication date: 2024-08-20
Anticipated expiration: 2044-06-11
Also published as: CN118338132A

Abstract

A shooting method, a shooting system, a storage medium and electronic equipment for flexible materials relate to the technical field of material shooting. The method comprises the following steps: acquiring material information of a target material, and determining a light source irradiation parameter based on the material information; controlling a light source device to irradiate the target material according to the light source irradiation parameters, and simultaneously controlling a true color line scanning camera to shoot the target material to obtain gray level pictures corresponding to all color channels; fusing the gray level pictures to obtain a material picture; and correcting the material picture to obtain a target picture. By implementing the technical scheme provided by the application, the reality of the flexible material picture can be improved.

Description

Shooting method and system for flexible material, storage medium and electronic equipment

Technical Field

The application relates to the technical field of material shooting, in particular to a shooting method and system for flexible materials, a storage medium and electronic equipment.

Background

In the field of production and quality control of other flexible materials such as textiles, composite materials and the like, shooting and analysis of the materials are important links for ensuring the quality of products. Quality inspection typically involves high resolution image capture of the surface of the flexible material in order to analyze its texture, color, presence of defects, etc.

In order to obtain high quality images, illumination plays an important role in the shooting process, and in the related art, array lamp beads are generally used as light sources to ensure sufficient illumination of the surface of the flexible material, and the array lamp beads can provide illumination with high intensity and relatively uniform illumination, which is theoretically beneficial to obtaining clear images. However, in practical application, when the light of the array light beads directly irradiates on the flexible material with specific textures, due to periodic interference between the light source and the textures of the flexible material, moire often occurs, so that when a camera is used for capturing a picture corresponding to the material, the effect of the moire is not only generated, but also generated, and therefore, the picture quality of the flexible material is lower in reality.

Disclosure of Invention

The application provides a shooting method and system for a flexible material, a storage medium and electronic equipment, which can improve the authenticity of a flexible material picture.

In a first aspect, the present application provides a method of photographing a flexible material, the method comprising:

Acquiring material information of a target material, and determining a light source irradiation parameter based on the material information;

controlling a light source device to irradiate the target material according to the light source irradiation parameters, and simultaneously controlling a true color line scanning camera to shoot the target material to obtain gray level pictures corresponding to all color channels;

Fusing the gray level pictures to obtain a material picture;

And correcting the material picture to obtain a target picture.

According to the technical scheme, the intensity, the angle and the distribution of the light source can be effectively adjusted according to the characteristics of the material by acquiring the material information of the target material and determining the light source irradiation parameters according to the material information, so that the irradiation condition is optimized, the occurrence of phenomena such as moire and false color caused by improper illumination is reduced, meanwhile, the target material is shot by using a true color line scanning camera, gray pictures corresponding to all color channels are acquired, the accuracy of image capturing is further improved, the gray pictures corresponding to all color channels are fused to obtain the material picture, the false color phenomenon is reduced by retaining the color information of the material, and due to the fact that the information obtained from a plurality of channels is integrated, the possible deviation in the capturing process of a single light source or a single color channel is reduced to a certain extent, the imaging authenticity is improved, and finally, the distortion and the moire that may be generated in the shooting process are further eliminated by correcting the material picture, the final target picture is more close to the actually observed material, and the reality of the flexible material shooting picture is improved.

Optionally, the acquiring the material information of the target material, determining the light source irradiation parameter based on the material information, includes: acquiring an initial image of the target material; analyzing the initial image to obtain position coordinates and color distribution of the target material; determining an illumination angle of the light source device based on the position coordinates; an illumination parameter of the light source device is determined based on the color distribution.

By adopting the technical scheme, an initial image of the target material is obtained, and then the accurate position coordinates of the material are obtained by analyzing by using an image processing algorithm. Meanwhile, the color distribution characteristics of the images are statistically analyzed, the brightness requirements of different areas are judged, and the accurate irradiation angle required by the light source can be calculated based on the position coordinates, so that the light can be accurately irradiated on the material, and the problem of dislocation is avoided; meanwhile, the illumination intensity required by different areas can be intelligently determined according to the color distribution, so that the accurate restoration of the color details of the materials is realized.

Optionally, a reflecting plate is disposed in a preset distance right in front of the light source device, and the determining the irradiation angle of the light source device based on the position coordinates includes: acquiring a first distance between the reflecting plate and the light source device and a second distance between the position coordinates of the target material and the reflecting plate; and calculating the irradiation angle of the light source device according to the first distance, the second distance and the size of the target material.

By adopting the technical scheme, the indirect distance between the light source and the material is measured by utilizing the closed loop structure formed by the reflecting plate, and the precise irradiation angle for enabling the material to receive light uniformly is deduced by combining the dimension parameters of the material and applying the triangular geometric relationship. By arranging the reflecting plate and acquiring the distance parameters between the reflecting plate and the light source and the material, the accurate calculation and control of the irradiation angle of the light source are realized.

Optionally, the controlling the light source device to irradiate the target material according to the light source irradiation parameter, and simultaneously controlling the true color line scanning camera to shoot the target material, so as to obtain a gray scale image corresponding to each color channel, including: controlling the light source equipment to irradiate the target material according to the irradiation angle and the illumination parameter; and simultaneously controlling each linear sensor in the true color line scanning camera to capture the target material to obtain gray level pictures corresponding to each color channel, wherein each linear sensor captures one color channel correspondingly.

By adopting the technical scheme, after the illumination parameters are determined, the illumination angle and the illumination intensity of the light source are accurately controlled, uniform and proper illumination is provided, meanwhile, the line scanning mode is adopted for shooting in a split-channel mode, color mixing is avoided, clear extraction of different color information is ensured, and the fidelity of pictures is greatly improved.

Optionally, the fusing the grayscale images to obtain a material image includes: performing geometric correction and color channel alignment on each gray level picture to obtain each standard gray level picture; performing line splicing on each standard gray level picture to obtain a complete gray level picture; and performing color calibration on the complete gray level picture to obtain a color image, and taking the color image as the material picture.

By adopting the technical scheme, on the basis of acquiring the gray level images of the sub-channels, geometric and color correction is firstly carried out, the difference between the channels is eliminated, then the standardized gray level images are spliced, the complete image information is restored, finally the color correction is carried out, a color image with high color reproducibility is generated, the color mixing is avoided through the shooting of the sub-channels, and the color consistency of different channels is ensured through the standardized processing.

Optionally, the correcting the material picture to obtain a target picture includes: converting the material picture from a spatial domain to a frequency domain; determining a frequency domain peak value corresponding to the mole pattern in the frequency domain, and removing the frequency domain peak value through filtering treatment to obtain a blank region corresponding to the frequency domain peak value; repairing the blank area based on an image repairing algorithm to obtain a repaired picture; and carrying out color correction on the repair picture based on a preset calibration standard to obtain a target picture.

Through adopting above-mentioned technical scheme, convert the material image to the frequency domain, discern the frequency component that corresponds mole line, then pass through filtering process and get rid of these frequencies accurately, obtain the image that does not have mole line, the frequency domain is handled and can effectively avoid the influence to other image details, through the filtration to clear frequency directly get rid of mole line, repair algorithm also makes the image after handling can not appear damaging, carry out the colour calibration at last, make the image colour effect accord with the standard, the automatic positioning and the elimination to mole line have been realized to whole process, not only removed pseudo-color and texture, but also remain abundant color and detail, the true degree has been greatly improved.

Optionally, after correcting the material picture to obtain the target picture, the method further includes: obtaining a normal vector component corresponding to X, Y, Z of each pixel point in the target picture; calculating the deviation of each normal vector component, and determining the defect type according to each deviation; and identifying the target picture based on the defect type to obtain an identified defect prompting picture.

By adopting the technical scheme, after the high-quality target image is obtained by removing the moire patterns, the normal vector information of each pixel is extracted, the deviation condition is analyzed to judge the possible position of the defect, the normal vector can represent the surface shape change of the material, the deviation directly corresponds to the defect condition of the surface, the accurate positioning of the defect is realized through the normal vector analysis, then different marks are given for different types of defects, the image with the prompting function is generated, and the automatic identification and prompting of the material defect are realized.

In a second aspect of the application there is provided a photographic system of flexible material, the system comprising:

The light source parameter determining module is used for acquiring material information of a target material and determining light source irradiation parameters based on the material information;

The control shooting module is used for controlling the light source equipment to irradiate the target material according to the light source irradiation parameters and controlling the true color line scanning camera to shoot the target material at the same time so as to obtain gray level pictures corresponding to all color channels;

The picture fusion module is used for fusing the gray pictures to obtain material pictures;

And the picture correction module is used for correcting the material picture to obtain a target picture.

In a third aspect the application provides a computer storage medium storing a plurality of instructions adapted to be loaded by a processor and to perform the above-described method steps.

In a fourth aspect of the application there is provided an electronic device comprising: a processor and a memory; wherein the memory stores a computer program adapted to be loaded by the processor and to perform the above-mentioned method steps.

In summary, one or more technical solutions provided in the embodiments of the present application at least have the following technical effects or advantages:

According to the application, the material information of the target material is obtained, the illumination parameters of the light source are determined according to the material information, the intensity, the angle and the distribution of the light source can be effectively adjusted according to the characteristics of the material, so that the illumination conditions are optimized, the occurrence of phenomena such as moire and false color caused by improper illumination is reduced, meanwhile, the true color line scanning camera is used for shooting the target material, gray level pictures corresponding to all color channels are obtained, the accuracy of image capturing is further improved, the gray level pictures corresponding to all color channels are fused to obtain the material picture, the false color phenomenon is reduced, and the information obtained from a plurality of channels is integrated, so that the possible deviation in the capturing process of a single light source or a single color channel is reduced to a certain extent, the imaging authenticity is improved, and finally, the distortion and the moire possibly generated in the shooting process are further eliminated through correcting the material picture, the final target picture is ensured to be closer to the actually observed material, and the reality of the photographed flexible material picture is improved.

Drawings

Fig. 1 is a schematic flow chart of a photographing method of a flexible material according to an embodiment of the present application;

FIG. 2 is a schematic view of a photographing system module of a flexible material according to an embodiment of the present application;

fig. 3 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

Reference numerals illustrate: 300. an electronic device; 301. a processor; 302. a communication bus; 303. a user interface; 304. a network interface; 305. a memory.

Detailed Description

In order that those skilled in the art will better understand the technical solutions in the present specification, the technical solutions in the embodiments of the present specification will be clearly and completely described below with reference to the drawings in the embodiments of the present specification, and it is apparent that the described embodiments are only some embodiments of the present application, not all embodiments.

In describing embodiments of the present application, words such as "for example" or "for example" are used to mean serving as examples, illustrations, or descriptions. Any embodiment or design described herein as "such as" or "for example" in embodiments of the application should not be construed as preferred or advantageous over other embodiments or designs. Rather, the use of words such as "or" for example "is intended to present related concepts in a concrete fashion.

In the description of embodiments of the application, the term "plurality" means two or more. For example, a plurality of systems means two or more systems, and a plurality of screen terminals means two or more screen terminals. Furthermore, the terms "first," "second," and the like, are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating an indicated technical feature. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include one or more such feature. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless expressly specified otherwise.

The following description of the embodiments of the present application will be given in detail with reference to the accompanying drawings, and it is apparent that the embodiments described are only some, but not all embodiments of the present application.

Referring to fig. 1, a flow chart of a method for photographing a flexible material is specifically provided, the method may be implemented by a computer program, may be implemented by a single-chip microcomputer, may also be run on a photographing system of the flexible material, the computer program may be integrated in an intelligent control device, and may also be run as an independent tool application, and specifically the method includes steps 10 to 40, where the steps are as follows:

Step 10: material information of a target material is acquired, and a light source irradiation parameter is determined based on the material information.

The embodiment of the application can be applied to, but not limited to, fields in which high-standard imaging is required for flexible materials, and can improve the authenticity and quality of images in the fields, such as production and quality control processes of flexible materials such as cloth textiles.

The target material in the embodiment of the application refers to various materials needing to be photographed, such as flexible materials, and the like, and can also be other articles. The material information may include, but is not limited to, an initial image of the material, location coordinates of the material, color distribution of the material, or other properties of the material, etc.

Specifically, the image sensor may be used to pre-photograph the target material to obtain an initial image of the target material, then the image processing algorithm is used to analyze the initial image, and specific position coordinates and color information of the target material are detected, so as to obtain material information of the target material. After the material information is obtained, calculating the optimal irradiation angle of the light source equipment according to the analyzed position coordinate data, judging the chromatographic reflection characteristic of the target material according to the color information, and selecting a proper light source illumination mode according to the characteristic, namely determining the light source irradiation parameters meeting the imaging requirement of the target material. The mode of the illumination scheme is determined by analyzing the target material information, the customized design can be carried out according to the specific conditions of the material, imaging problems caused by improper positions and parameters of the light source can be reduced, and the illumination pertinence is improved. It is necessary to acquire material information and determine the light source parameters based on the material information because the requirements for illumination conditions are different from one material to another due to differences in position, surface shape, color, reflection characteristics, etc. If the unified illumination scheme is directly determined without considering the material information, the mismatch between the light source setting and the material characteristics is easily caused, and complex light shadows and illumination angles are formed, so that serious imaging problems are caused. In the embodiment, the irradiation parameters of the light source can be adjusted in a targeted manner by analyzing the conditions of the material in advance, so that the problems are effectively avoided, the illumination conditions are ensured to accord with the characteristics of the material, and the imaging effect is improved.

On the basis of the above embodiment, as an alternative embodiment, the step of acquiring material information of the target material and determining the light source irradiation parameter based on the material information may further include the steps of:

Step 101: an initial image of the target material is acquired.

Step 102: and analyzing the initial image to obtain the position coordinates and the color distribution of the target material.

Specifically, before determining the irradiation parameters of the light source, an initial image of the target material needs to be acquired and analyzed to obtain position coordinates and color distribution information of the material, and the image sensor is controlled to shoot the target material to obtain the initial image. Then, the initial image is processed and analyzed, and specific contours and position coordinates of the target material in the shooting scene are detected through image processing algorithms such as edge detection, shape segmentation and the like. And analyzing the color composition in the initial image based on a color analysis algorithm, and extracting color data of the surface points of the target material to obtain color distribution information of the material. The initial image is acquired and resolved in advance because the position coordinates and color distribution of the material are two key information that must be considered in designing the illumination scheme. The position coordinates are used for calculating the optimal angle configuration of the light source to the material; the color distribution is used to determine the color temperature and intensity parameters of the light source. It is difficult to reasonably set the illumination parameters without parsing the initial image to obtain both pieces of information. The pre-analysis of the initial image can provide the information to guide the subsequent determination of the parameters of the light source, so that the illumination scheme is matched with the position distribution of the material in the scene and the color characteristics of the material, thereby ensuring the optimal illumination effect.

Step 103: an illumination angle of the light source device is determined based on the position coordinates.

The light source device is a lighting device capable of generating shadowless or approximately unidirectional light, and the light source device can effectively reduce moire between light and materials by eliminating multi-directional crossed light. In addition, the embodiment of the application also provides the reflecting plate which can reflect and adjust the angle, so that the light rays are reflected by the reflecting plate and then irradiated to the surface of the target material, the direct irradiation influence of the light rays can be further eliminated, and the illumination is softer and more uniform. The specific positional relationship is that the light source equipment is arranged at one side of the scene, the reflecting plate is arranged in the preset distance right in front of the light source equipment, the true color line scanning camera is arranged at the other side of the scene different from the light source equipment and is symmetrical with the light source equipment, the camera of the true color line scanning camera is aligned with the target material, and the target material is arranged at the right middle position of the light source equipment and the true color line scanning camera. When the light emitted by the light source directly irradiates the target material, obvious light-shadow difference can be generated to influence the imaging effect, the reflecting plate can lead the light to irradiate on the reflecting plate firstly, then after diffuse reflection, the light rays which are softened and uniform are incident on the surface of the target material, the incidence direction and the intensity distribution of the light rays can be optimized by arranging the reflecting plate, the illumination uniformity of the material is improved, and the imaging effect and the image quality are improved.

Specifically, first, the distance between the light source device and the target material is calculated from the position coordinates of the target material in the shooting scene. And then combining the distance between the light source and the reflecting plate, and determining the incident angle and the reflecting angle of the light source to the material according to the reflection principle of the light rays. Finally, comprehensively considering the factors such as the shape, the surface characteristics and the like of the material, calculating the optimal angle value which can achieve uniform irradiation and avoid different brightness, namely determining the irradiation angle parameters of the light source. The light source angle is determined based on the position coordinates of the target materials, because the reflection receiving effects of the target materials at different positions on the incident light rays are different, if the light source angle cannot adapt to the position coordinates, the problem that the local area of the target material is too bright or too dark is easily caused, and the imaging effect is affected. The light source angle is set by calculating the coordinate of the matched position, so that light rays can be ensured to irradiate the surface of the whole material in an optimal mode, the illumination uniformity is improved, and the imaging quality is prevented from being reduced.

On the basis of the above-described embodiment, as an alternative embodiment, the step of determining the irradiation angle of the light source device based on the position coordinates may further include the steps of:

Step 1031: a first distance between the reflecting plate and the light source device, and a second distance between the position coordinates of the target material and the reflecting plate are acquired.

Specifically, the distance between the light source device and the reflection plate, i.e., the first distance, is measured and recorded by using the distance sensor. Then, according to the obtained position coordinates of the target material, the distance between the target material and the reflecting plate, namely, the second distance is calculated through the geometric relationship by combining the known size and the known position of the reflecting plate. The purpose of obtaining parameters of these two distances is to provide an input value for the calculation of the illumination angle, the angle of incidence being equal to the angle of reflection according to the law of reflection of the light rays, both angles being related to the sum of the two distance values. Only if the two distances are accurately measured, the included angle formed by illumination and the light receiving surface of the material can be calculated, namely, the accurate illumination angle of the light source is determined.

Step 1032: the illumination angle of the light source device is calculated from the first distance, the second distance, and the size of the target material.

Specifically, after obtaining the first distance D1 from the light source device to the reflective plate and then calculating the second distance D2 from the target material to the reflective plate, and obtaining the dimension parameters of the material, the length L and the width W of the target material, and taking the three distances and the dimension parameters into consideration, the position coordinate points (x, y) of the incident light to the surface of the material can be deduced according to the planar geometry relationship. And combining the coordinate points (x, y) and the normal direction of the target material, and then calculating the accurate irradiation angle theta of the surface of the light incident material by applying the reflection law of light. The calculation method is feasible because the reflection of the light is closely related to the receiving direction of the surface of the material, and each distance parameter and the size of the material must be considered to accurately derive the incident point and the corresponding angle of the light on the light receiving surface of the material.

For example, assuming that the measured first distance d1=50 cm, second distance d2=80 cm, material length l=20 cm, and width w=10 cm, the coordinate point at which the light is irradiated on the surface of the material can be calculated as (8, 6), and then the optimum irradiation angle θ can be deduced to be 30 ° from the normal direction of the material.

Step 104: the illumination parameters of the light source device are determined based on the color distribution.

Specifically, the illumination parameters of the light source device are determined according to the color distribution characteristics of the target material, and the illumination parameters mainly comprise light intensity, color temperature and the like, so that the purpose of realizing real color restoration of the material is achieved. After the color distribution information of the target material is acquired, color and brightness values of the regional points at different positions are acquired, and a color sampling database is generated through statistics. And then analyzing the main color distribution characteristics in the database, judging whether the whole material is warm or cold, and determining a proper light source color temperature parameter. And then determining the required light source intensity output power according to the depth contrast of the surface color of the material sample, and finally integrating the color temperature and the intensity parameters to complete the illumination mode setting of the light source equipment.

Illustratively, if the surface color of the analysis material is based on blue and green hues by sampling, the color gradation does not change much. It is possible to determine a 5500K light source with a colder color temperature and to select a lower output intensity of 500 lumens based on the characteristic of a small color contrast. Through the arrangement, the light source device can emit illumination light matched with the color distribution characteristics of the materials, so that the imaging effect is more vivid.

Step 20: and controlling the light source equipment to irradiate the target material according to the light source irradiation parameters, and simultaneously controlling the true color line scanning camera to shoot the target material to obtain gray level pictures corresponding to all color channels.

The true color line scanning camera is professional image equipment capable of performing linear scanning shooting, and can perform high-speed and high-resolution progressive scanning imaging through a linear CCD sensor, so that compared with the integral imaging of a common digital camera, the true color line scanning camera can acquire more abundant image detail information. In the embodiment of the application, the true color line scanning camera can be used for scanning stronger layering, and the image information of red, green, blue and other color channels can be separated. The true color line scanning camera can provide a high-resolution multichannel scanning imaging function, acquire abundant material optical information, be favorable to accurate reduction of material colors and promote imaging efficiency.

Specifically, after the irradiation angle and the illumination parameters of the light source are determined, the light source device is required to be controlled to accurately illuminate the target material according to the irradiation parameters, an illumination control instruction is given to the light source device, and the illumination angle and the light parameters are set to enable the light source device to emit light according to a set mode. And when the illumination control instruction is issued, issuing a shooting instruction to control the true color line scanning camera to scan the shooting target material in a line-to-line mode, and synchronously carrying out the shooting in combination with the illumination of the light source. When the true color line scanning camera shoots, different filters can be arranged to acquire the image information of three color channels of red, green and blue respectively. And finally, arranging all scanning line images, and stacking red, green and blue gray level images of the target material on each color channel. The specific reflection characteristic information of the material under different colors of light can be obtained through the multichannel progressive scanning shooting, and the specific reflection characteristic information is layered to serve as basic data of post-processing. If the whole image is directly shot, the absorption and reflection characteristics of the material to the light rays with different colors are difficult to separate, and the layered scanning can provide enough detailed optical characteristic data so as to be convenient for restoring images according to the true colors of the material in the later period.

On the basis of the above embodiment, as an optional embodiment, the step of controlling the light source device to irradiate the target material according to the light source irradiation parameter and simultaneously controlling the true color line scanning camera to shoot the target material to obtain the gray level picture corresponding to each color channel may further include the following steps:

step 201: and controlling the light source equipment to irradiate the target material according to the irradiation angle and the illumination parameters.

Specifically, after determining the illumination angle and illumination parameters of the light source device, it is necessary to precisely control the light source device to precisely illuminate the target material according to the parameters, for example, setting the horizontal and vertical angles of the light source to be the calculated optimal illumination angle θ, for example, θ=30°, setting the output wavelength range and intensity of the light source, matching the color temperature and brightness parameters of the material sample, for example, color temperature 5000K and brightness 300 lumens, converting the parameters into controllable instructions, issuing the executable instructions to the light source device, controlling the internal mechanism of the light source device, adjusting the angle of the light source to the preset θ=30°, starting the light source illumination, outputting light according to the set wavelength range and intensity, and illuminating the surface of the target material.

Step 202: and simultaneously controlling each linear sensor in the true color line scanning camera to capture the target material to obtain gray level pictures corresponding to each color channel, and capturing one color channel corresponding to each linear sensor.

Specifically, in order to obtain the reflection response characteristics of the target material under different color illumination, three RGB linear sensors in the true color line scanning camera are required to be controlled to perform progressive scanning shooting on the target material, and each sensor respectively captures image information of one color channel. Filters of three colors of red, green and blue are arranged on an optical path of a true color line scanning camera, so that each linear sensor only receives light rays of corresponding wave bands. Then selecting one linear sensor one by one, sending a scanning execution instruction, controlling the sensor to start from the leftmost end of the material, scanning the surface of the material in a row and shooting an image, and repeating the process until all the sensors finish shooting, so that a gray picture of the target material under illumination of one color can be obtained in each shooting. The layered progressive scanning shooting is performed because the reflection and scattering effects of the light rays with different colors on the surface of the material are different, and the reflection response images under the respective color light rays must be respectively obtained to completely record the optical characteristic information of the material. The color channel data of the gray level pictures becomes the basis of real color restoration of materials, and the line scanning shooting can provide high-speed and high-resolution image capturing capability, thereby being beneficial to obtaining fine and clear scanning images.

The RGB three-channel information is captured by the layered control line scanning camera, so that the optical characteristic data of the material under different color illumination can be obtained efficiently, original color basic data can be provided for later image processing, and the color reduction quality of the material can be improved.

Step 30: and fusing the gray level pictures to obtain the material picture.

Specifically, after obtaining the gray level images of the target material under the red, green and blue color channels, the three gray level images need to be subjected to image fusion, and finally, a complete image representing the true color of the material is synthesized. First, three gray-scale images are subjected to row-column correction, so that the image sizes and alignment of all color channels are consistent. And then taking the red gray level image as a red channel, taking the green gray level image as a green channel and taking the blue gray level image as a blue channel, and carrying out superposition fusion of three channels of RGB. And calculating and synthesizing corresponding RGB colors according to the gray values of each pixel in the three channels, and finally obtaining a material picture representing the real color information of the material. The fusion of gray images is mainly used for recovering the true color expression effect of the material, and an independent gray image only contains the light and shade information of each color channel, but cannot represent the final color characteristics of the material, the information of the three channels is integrated, and the colors are calculated and generated according to the proportional relation of the color and the light intensity of the three channels, so that the colors of the material can be accurately reconstructed and presented in the image.

On the basis of the above embodiment, as an optional embodiment, the step of fusing the grayscale pictures to obtain the material picture may further include the following steps:

Step 301: and performing geometric correction and color channel alignment on each gray level picture to obtain each standard gray level picture.

Specifically, a geometric correction tool of image processing software can be used to detect the boundary contour of each gray-scale picture and calculate the geometric deformation such as inclination, rotation and the like of the image. And then, according to the deformation parameters, correcting and transforming the pixel points of the image, and adjusting the geometric shape of the image into a standard square to finish geometric correction. And then, carrying out position alignment on the gray level images of all the color channels, calculating to enable the target material main body ranges of the three gray level images to be precisely overlapped, adjusting the material positions in the three color channels to be consistent through operations such as zooming, moving and the like, and completing the alignment of the color channels. Because the original scanned image has errors such as position, size and the like, direct fusion can lead different channels to be unable to align to generate chromatic aberration, deformation can be eliminated by geometric correction, and channel alignment ensures that each pixel point is completely corresponding, thereby being beneficial to correctly synthesizing color information of materials.

Step 302: and performing line splicing on each standard gray level picture to obtain a complete gray level picture.

Specifically, the line number information of each standard gray level image is firstly obtained, the line number which needs to be increased for each gray level image is calculated to be matched with the final image size, then each gray level image is subjected to line copying, the required line number is added below the image, the image range is expanded, then a linear interpolation algorithm is used for smoothly transiting and fusing the newly added line and the original line, so that the newly added line and the original line are in seamless connection, the image is in a continuous and complete state, and each gray level image can be converted into a complete gray level image with complete line number after line addition and interpolation. The method has the advantages that the line splicing linear array scanning mode enables only a specific line number to be scanned and shot each time, the whole image cannot be directly obtained, missing line information in each standard gray level image must be reasonably supplemented for restoring the complete material image, and the linear interpolation can enable the newly added line to be naturally fused with the original image to avoid obvious boundaries.

Step 303: and carrying out color calibration on the complete gray level picture to obtain a color image, and taking the color image as a material image.

Specifically, a color comparison table of the target material is firstly established, and reference color data of the target material in different areas are stored. And then inputting a three-channel complete gray level chart on image processing software, loading a reference color comparison table in a color calibration module, and selecting a color mapping algorithm such as tri-linear regression and the like. And remapping and calculating the brightness values of the three channels according to the algorithm and the reference color data, converting the color attribute of each pixel, and converting the gray level image into a color image representing the color of the real material. The reason for performing color calibration is that the pixel values in the three-channel gray scale map only represent the intensity information of the light rays with different color components, and the color values must be converted into the actual material colors through color attribute calculation, so that the calculation can be more accurate by loading the material color sample data. And the real material color can not be obtained by directly splicing the gray level images, and the optimal color reproduction effect can be realized only through color calibration.

Step 40: and correcting the material picture to obtain a target picture.

Specifically, after the image representing the color information of the material is obtained, image correction is also required to improve the visual quality of the image, and a target image which finally presents the details of the material is generated.

In an alternative embodiment, the color balance of the image may be detected, with selective color enhancement in the desired areas, balancing the color of the image in the highlight and shadow areas. And correcting the definition of the image, and enhancing detail features in the image by means of improving contrast, sharpening edges and the like. And then carrying out noise filtration, removing image noise points by using algorithms such as median filtration, gaussian filtration and the like, and finally carrying out distortion correction to eliminate geometric deformation of the image and output an image result with rectangular specification. Performing image correction further improves the visual effect and aesthetics of the target image. Through color balance, definition adjustment and noise filtration, the image color can be richer and balanced, the details are more outstanding and clear, the visual effect is better, and the geometric shape of the standard image meets the image quality requirement.

In another alternative embodiment, a fast fourier transform may be used to transform the material image from the spatial domain to the frequency domain, obtaining spectral information of the image. Then, the peak area of the moire represented by the high-frequency part is analyzed and determined in the spectrogram, and a digital filter is designed to inhibit the peaks in a targeted manner, so that the corresponding frequency components are eliminated. The filtered spectrogram shows blank areas representing moire information. Then, an image restoration algorithm, such as an interpolation method, is used to estimate the frequency components of the blank area according to the surrounding normal frequency spectrum information, so as to restore the information of the blank area, and then inverse Fourier transform is performed to convert the processed frequency spectrum back to the image space domain, so that the image with the moire removed is obtained. Finally, to compensate for the fine chromatic aberration caused by the frequency domain processing, color correction is required, image color parameters are adjusted according to a preset color calibration standard, gamma correction is performed, and a target image with better color effect is output.

On the basis of the above embodiment, as an optional embodiment, the step of correcting the material picture to obtain the target picture may further include the steps of:

Step 401: the material picture is converted from the spatial domain to the frequency domain.

Step 402: and determining a frequency domain peak value corresponding to the mole pattern in the frequency domain, and removing the frequency domain peak value through filtering processing to obtain a blank area corresponding to the frequency domain peak value.

Specifically, in order to remove the moire signal in the material image in the frequency domain, the material image needs to be converted from the spatial domain to the frequency domain first, because the pixel information in the spatial domain is mixed together, the moire and the normal detail are not easy to distinguish, and by converting to the frequency domain, different information can be separated according to the frequency, so that the moire can be effectively identified and processed. And the direct processing in the frequency domain can only remove the moire information, can not influence other image areas, and can avoid detail loss possibly caused by the direct processing in the spatial domain. And carrying out Fourier transform on pixel information of the material picture by adopting a fast Fourier transform algorithm, and converting the image from a space domain to a frequency domain to obtain spectrum information of the image. The high-frequency signal areas representing the mole patterns are analyzed and identified in the spectrogram, the areas are represented as frequency domain peaks in the spectrogram, frequency coordinates corresponding to the frequency domain peaks can be determined according to the frequency domain distribution characteristics of the mole patterns in different directions, and then a digital filter is designed to eliminate the peak areas. The specific method is that a stop band of the filter is set at the peak frequency, so that the filter can inhibit the frequency components in a targeted way. And then processing the spectrogram by using the filter, filtering the frequency corresponding to the peak value, and finally obtaining the spectrogram with the moire peak value frequency as a blank.

Step 403: and repairing the blank area based on an image repairing algorithm to obtain a repaired picture.

Specifically, after the filtering process is performed on the material picture in the frequency domain, a blank area representing moire information appears. These blank areas lack normal spectral information in the original image and if converted directly back to the spatial domain, this will result in loss of image information in these areas and defects. To supplement the missing information of the blank area, it is necessary to process with an image restoration algorithm. Specifically, an interpolation method is used for carrying out smooth interpolation based on normal frequency spectrum information around the blank area, and the frequency spectrum information of the blank area is estimated according to the adjacent frequency spectrum change rule, so that reasonable information restoration of the blank area is realized. The original detailed information of the image is kept as much as possible while the moire is removed, so that the introduction of defects is avoided, and the visual effect of the image is improved.

Step 404: and carrying out color correction on the repair picture based on a preset calibration standard to obtain a target picture.

Specifically, after the mole lines are removed by frequency domain processing, due to the change of frequency spectrum information, a certain color difference problem may occur in the restored picture obtained by inverse transformation, color calibration is needed to improve the image effect, and a color calibration standard of the material, such as setting standard color parameter ranges of RGB, HSV and the like, is preset. And then loading the repair picture, and detecting the deviation of the color distribution condition and the standard reference. Then, the color attribute of the image is remapped through an algorithm such as tri-linear regression and the like, the RGB components are adjusted to meet the preset reference parameter requirements, the deviation of the repaired picture in terms of color can be eliminated, and a target picture with better visual effect is output.

On the basis of the above embodiment, as an optional embodiment, after the step of correcting the material picture to obtain the target picture, the method may further include the following steps:

step 501: and obtaining a normal vector component corresponding to X, Y, Z of each pixel point in the target picture.

Specifically, after the target picture is obtained, the quality of the target material can be detected, and in the image processing software, the RGB value of the target picture is analyzed, so that a three-dimensional coordinate system of the image is established. Then, by calculating the height change condition of the pixels around each pixel point, three component values corresponding to X, Y, Z of the normal vector of the surface of each pixel point are approximately calculated by using a numerical differentiation method. The normal vector can well represent the normal direction change of the image surface, and is important information for judging the surface morphology. Different surface relief conditions can cause different degrees of variation of normal vector components, so that image normal vector component data are needed to be acquired first, and a basis is provided for judging and positioning surface defects according to the normal vector variation conditions.

Step 502: and calculating the deviation of each normal vector component, and determining the defect type according to each deviation.

Specifically, after the normal vector component of each pixel point is obtained, the deviation degree of the normal vector component in the same area needs to be calculated. Specifically, the target picture is segmented, statistical analysis is carried out on the normal vector component values of a plurality of pixels in each small block, and the variance of X, Y, Z components in the same block is calculated. And setting a normal vector deviation threshold value of various defects according to a normal vector change model of different types of defects, such as more prominent normal vector deviation corresponding to the dent defects. And finally, matching the normal vector deviation in each block with a threshold value table to judge the defect type corresponding to each image block, thereby completing the automatic identification of the defects. Different surface imperfections can produce different degrees of offset variation in the normal vector distribution. Such as dent defects, can result in more dramatic normal vector changes. And judging what type of defects are according to the deviation amplitude of the normal vector, thereby realizing intelligent defect classification based on normal vector information.

Step 503: and marking the target picture based on the defect type to obtain a marked defect prompting picture.

Specifically, after various defects and positions thereof in the target picture are identified, targeted image labeling is required to generate a defect identification diagram with a prompting function. Different types of defects may be represented by selecting different colored bounding boxes, such as using red fiducial mark recess defects, green fiducial mark burr defects, etc. Then, in the image processing software, color bounding boxes representing the corresponding defect types are drawn one by one on the target picture according to the known defect position information, so that the defect areas are strictly covered. Thus, a defect extraction map that intuitively marks all defect information can be obtained. The method is convenient for the detection of various defects to be clear at a glance, and provides visual support for the later defect analysis and material improvement.

Referring to fig. 2, a schematic view of a photographing system module of a flexible material according to an embodiment of the application may include: the system comprises a light source parameter determining module, a picture fusing module and a picture correcting module, wherein:

Optionally, the light source parameter determining module is further configured to obtain an initial image of the target material; analyzing the initial image to obtain position coordinates and color distribution of the target material; determining an illumination angle of the light source device based on the position coordinates; an illumination parameter of the light source device is determined based on the color distribution.

Optionally, the light source parameter determining module is further configured to obtain a first distance between the reflecting plate and the light source device, and a second distance between the position coordinates of the target material and the reflecting plate;

And calculating the irradiation angle of the light source device according to the first distance, the second distance and the size of the target material.

Optionally, the control shooting module is further configured to control the light source device to irradiate the target material according to the irradiation angle and the illumination parameter; and simultaneously controlling each linear sensor in the true color line scanning camera to capture the target material to obtain gray level pictures corresponding to each color channel, wherein each linear sensor captures one color channel correspondingly.

Optionally, the image fusion module is further configured to perform geometric correction and color channel alignment on each gray-scale image to obtain each standard gray-scale image; performing line splicing on each standard gray level picture to obtain a complete gray level picture; and carrying out color calibration on the complete gray level picture to obtain a color image, and taking the color image as the material image.

Optionally, the picture correction module is further configured to convert the material picture from a spatial domain to a frequency domain; determining a frequency domain peak value corresponding to the mole pattern in the frequency domain, and removing the frequency domain peak value through filtering treatment to obtain a blank region corresponding to the frequency domain peak value; repairing the blank area based on an image repairing algorithm to obtain a repaired picture; and carrying out color correction on the repair picture based on a preset calibration standard to obtain a target picture.

Optionally, the photographing system of the flexible material further comprises a defect quality inspection module, wherein the defect quality inspection module is used for acquiring normal vector components corresponding to X, Y, Z of each pixel point in the target picture; calculating the deviation of each normal vector component, and determining the defect type according to each deviation; and identifying the target picture based on the defect type to obtain an identified defect prompting picture.

It should be noted that: in the system provided in the above embodiment, when implementing the functions thereof, only the division of the above functional modules is used as an example, in practical application, the above functional allocation may be implemented by different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules, so as to implement all or part of the functions described above. In addition, the system and method embodiments provided in the foregoing embodiments belong to the same concept, and specific implementation processes of the system and method embodiments are detailed in the method embodiments, which are not repeated herein.

The embodiment of the present application further provides a computer storage medium, where the computer storage medium may store a plurality of instructions, where the instructions are suitable for being loaded by a processor and executed by a processor, and a specific execution process may refer to a specific description of the foregoing embodiment, and will not be described herein.

Referring to fig. 3, the application also discloses an electronic device. Fig. 3 is a schematic structural diagram of an electronic device according to the disclosure. The electronic device 300 may include: at least one processor 301, at least one network interface 304, a user interface 303, a memory 305, at least one communication bus 302.

Wherein the communication bus 302 is used to enable connected communication between these components.

The user interface 303 may include a Display screen (Display), a Camera (Camera), and the optional user interface 303 may further include a standard wired interface, and a wireless interface.

The network interface 304 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface), among others.

Wherein the processor 301 may include one or more processing cores. The processor 301 utilizes various interfaces and lines to connect various portions of the overall server, perform various functions of the server and process data by executing or executing instructions, programs, code sets, or instruction sets stored in the memory 305, and invoking data stored in the memory 305. Alternatively, the processor 301 may be implemented in at least one hardware form of digital signal Processing (DIGITAL SIGNAL Processing, DSP), field-Programmable gate array (Field-Programmable GATE ARRAY, FPGA), programmable logic array (Programmable Logic Array, PLA). The processor 301 may integrate one or a combination of several of a central processing unit (Central Processing Unit, CPU), an image processor (Graphics Processing Unit, GPU), and a modem, etc. The CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for rendering and drawing the content required to be displayed by the display screen; the modem is used to handle wireless communications. It will be appreciated that the modem may not be integrated into the processor 301 and may be implemented by a single chip.

The Memory 305 may include a random access Memory (Random Access Memory, RAM) or a Read-Only Memory (Read-Only Memory). Optionally, the memory 305 includes a non-transitory computer readable medium (non-transitory computer-readable storage medium). Memory 305 may be used to store instructions, programs, code, sets of codes, or sets of instructions. The memory 305 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing the above-described respective method embodiments, etc.; the storage data area may store data or the like involved in the above respective method embodiments. Memory 305 may also optionally be at least one storage device located remotely from the aforementioned processor 301. Referring to fig. 3, an operating system, a network communication module, a user interface module, and an application program of a photographing method of a flexible material may be included in the memory 305 as a computer storage medium.

In the electronic device 300 shown in fig. 3, the user interface 303 is mainly used for providing an input interface for a user, and acquiring data input by the user; and the processor 301 may be used to invoke an application program in the memory 305 that stores a photographing method of a flexible material, which when executed by the one or more processors 301, causes the electronic device 300 to perform the method as described in one or more of the embodiments above. It should be noted that, for simplicity of description, the foregoing method embodiments are all described as a series of acts, but it should be understood by those skilled in the art that the present application is not limited by the order of acts described, as some steps may be performed in other orders or concurrently in accordance with the present application. Further, those skilled in the art will also appreciate that the embodiments described in the specification are all of the preferred embodiments, and that the acts and modules referred to are not necessarily required for the present application.

In the foregoing embodiments, the descriptions of the embodiments are emphasized, and for parts of one embodiment that are not described in detail, reference may be made to related descriptions of other embodiments.

In the several embodiments provided by the present application, it should be understood that the disclosed apparatus may be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative, such as a division of units, merely a division of logic functions, and there may be additional divisions in actual implementation, such as multiple units or components may be combined or integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be through some service interface, device or unit indirect coupling or communication connection, electrical or otherwise.

The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed over a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in the embodiments of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.

The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable memory. Based on this understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art or in whole or in part in the form of a software product stored in a memory, comprising several instructions for causing a computer device (which may be a personal computer, a server or a network device, etc.) to perform all or part of the steps of the method of the various embodiments of the present application. And the aforementioned memory includes: various media capable of storing program codes, such as a U disk, a mobile hard disk, a magnetic disk or an optical disk.

The foregoing is merely exemplary embodiments of the present disclosure and is not intended to limit the scope of the present disclosure. That is, equivalent changes and modifications are contemplated by the teachings of this disclosure, which fall within the scope of the present disclosure. Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure.

This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a scope and spirit of the disclosure being indicated by the claims.

Claims

1. A method of photographing a flexible material, the method comprising:

wherein acquiring material information of a target material, determining a light source irradiation parameter based on the material information, comprises:

acquiring an initial image of a target material;

Analyzing the initial image to obtain position coordinates and color distribution of the target material;

determining an illumination angle of the light source device based on the position coordinates;

determining an illumination parameter of the light source device based on the color distribution;

Fusing the gray level pictures to obtain a material picture;

And correcting the material picture to obtain a target picture.

2. The photographing method of a flexible material according to claim 1, wherein a reflecting plate is provided within a preset distance right in front of the light source device, and the determining the irradiation angle of the light source device based on the position coordinates comprises:

acquiring a first distance between the reflecting plate and the light source device and a second distance between the position coordinates of the target material and the reflecting plate;

3. The method according to claim 1, wherein the controlling the light source device to irradiate the target material according to the light source irradiation parameter, and simultaneously controlling the true color line scanning camera to photograph the target material, so as to obtain gray-scale pictures corresponding to each color channel, includes:

controlling the light source equipment to irradiate the target material according to the irradiation angle and the illumination parameter;

And simultaneously controlling each linear sensor in the true color line scanning camera to capture the target material to obtain gray level pictures corresponding to each color channel, wherein each linear sensor captures one color channel correspondingly.

4. The method for photographing a flexible material according to claim 1, wherein said fusing each of said grayscale images to obtain a material image comprises:

Performing geometric correction and color channel alignment on each gray level picture to obtain each standard gray level picture;

Performing line splicing on each standard gray level picture to obtain a complete gray level picture;

And performing color calibration on the complete gray level picture to obtain a color image, and taking the color image as the material picture.

5. The method of claim 1, wherein correcting the material picture to obtain a target picture comprises:

Converting the material picture from a spatial domain to a frequency domain;

Determining a frequency domain peak value corresponding to the mole pattern in the frequency domain, and removing the frequency domain peak value through filtering treatment to obtain a blank region corresponding to the frequency domain peak value;

Repairing the blank area based on an image repairing algorithm to obtain a repaired picture;

and carrying out color correction on the repair picture based on a preset calibration standard to obtain a target picture.

6. The method for photographing a flexible material according to claim 1, wherein after correcting the material picture to obtain a target picture, further comprising:

obtaining a normal vector component corresponding to X, Y, Z of each pixel point in the target picture;

Calculating the deviation of each normal vector component, and determining the defect type according to each deviation;

And identifying the target picture based on the defect type to obtain an identified defect prompting picture.

7. A photographing system of flexible material, the system comprising:

the light source parameter determining module is used for acquiring material information of a target material and determining light source irradiation parameters based on the material information; wherein acquiring material information of a target material, determining a light source irradiation parameter based on the material information, comprises: acquiring an initial image of a target material; analyzing the initial image to obtain position coordinates and color distribution of the target material; determining an illumination angle of the light source device based on the position coordinates; determining an illumination parameter of the light source device based on the color distribution;

8. A computer readable storage medium storing a plurality of instructions adapted to be loaded by a processor and to perform the method of any one of claims 1-6.

9. An electronic device comprising a processor, a memory, a user interface, and a network interface, the memory for storing instructions, the user interface and the network interface for communicating to other devices, the processor for executing the instructions stored in the memory to cause the electronic device to perform the method of any of claims 1-6.