CN118052727A - Image noise reduction processing method and device and computer equipment - Google Patents
Image noise reduction processing method and device and computer equipment Download PDFInfo
- Publication number
- CN118052727A CN118052727A CN202410032321.3A CN202410032321A CN118052727A CN 118052727 A CN118052727 A CN 118052727A CN 202410032321 A CN202410032321 A CN 202410032321A CN 118052727 A CN118052727 A CN 118052727A
- Authority
- CN
- China
- Prior art keywords
- image
- denoising
- scaling
- result
- noise reduction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000009467 reduction Effects 0.000 title claims abstract description 66
- 238000003672 processing method Methods 0.000 title abstract description 17
- 230000000694 effects Effects 0.000 claims abstract description 42
- 238000012545 processing Methods 0.000 claims abstract description 21
- 238000013139 quantization Methods 0.000 claims abstract description 21
- 238000000034 method Methods 0.000 claims description 42
- 238000004590 computer program Methods 0.000 claims description 17
- 238000013528 artificial neural network Methods 0.000 claims description 14
- 238000003062 neural network model Methods 0.000 claims description 6
- 238000013507 mapping Methods 0.000 claims description 3
- 230000008569 process Effects 0.000 description 19
- 238000004891 communication Methods 0.000 description 14
- 238000010586 diagram Methods 0.000 description 13
- 230000008859 change Effects 0.000 description 5
- 230000003287 optical effect Effects 0.000 description 5
- 101001121408 Homo sapiens L-amino-acid oxidase Proteins 0.000 description 3
- 101000827703 Homo sapiens Polyphosphoinositide phosphatase Proteins 0.000 description 3
- 102100026388 L-amino-acid oxidase Human genes 0.000 description 3
- 102100023591 Polyphosphoinositide phosphatase Human genes 0.000 description 3
- 101100233916 Saccharomyces cerevisiae (strain ATCC 204508 / S288c) KAR5 gene Proteins 0.000 description 3
- 230000003068 static effect Effects 0.000 description 2
- 101100012902 Saccharomyces cerevisiae (strain ATCC 204508 / S288c) FIG2 gene Proteins 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000012549 training Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T3/4007—Scaling of whole images or parts thereof, e.g. expanding or contracting based on interpolation, e.g. bilinear interpolation
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Image Processing (AREA)
Abstract
Description
技术领域Technical Field
本申请涉及图像处理领域,尤其涉及一种图像降噪处理方法、装置及计算机设备。The present application relates to the field of image processing, and in particular to an image noise reduction processing method, device and computer equipment.
背景技术Background technique
图像降噪是一种可以减弱图像噪声、改善图像质量的图像处理方法,主要可以包括基于组合滤波器的降噪和基于神经网络的降噪等方式。基于滤波器的降噪方法硬件友好度较高,但降噪频率单一,且堆叠多重滤波器容易造成细节损失丢失;基于神经网络的降噪方法硬件友好度较低,但通过复杂的网络学习可以在保证细节的情况下较好地处理图像噪声。Image denoising is an image processing method that can reduce image noise and improve image quality. It can mainly include denoising based on combined filters and denoising based on neural networks. The filter-based denoising method is more hardware-friendly, but the denoising frequency is single, and stacking multiple filters can easily cause loss of details; the neural network-based denoising method is less hardware-friendly, but through complex network learning, it can better handle image noise while ensuring details.
基于滤波器的降噪模型为了保证图像的细节不严重受损,往往使用单一频段的滤波器,对非所属频段的噪声不能很好地去除。而神经网络降噪模型由于其参数量和计算量要求过高,为获得更高的硬件匹配度,在应用时往往需要减少参数量降低算力,导致神经网络降噪模型无法处理全频域内的数值信息,只能将算力偏向性地用于处理频域集中分布的值。这两种方式在某一特定频段具有较强的图像降噪能力,对该特定频段之外的图像数据处理能力较差,导致图像降噪模型的整体可用性不强。In order to ensure that the details of the image are not seriously damaged, the filter-based denoising model often uses a single-band filter, which cannot effectively remove noise in non-bands. However, due to its high parameter and computational requirements, the neural network denoising model often needs to reduce the number of parameters and computing power in order to obtain a higher hardware matching degree. As a result, the neural network denoising model cannot process numerical information in the full frequency domain, and can only use computing power to process values concentrated in the frequency domain. These two methods have strong image denoising capabilities in a specific frequency band, but have poor processing capabilities for image data outside of this specific frequency band, resulting in the overall low usability of the image denoising model.
发明内容Summary of the invention
本申请实施例提供一种图像降噪处理方法、装置及计算机设备,以解决图像降噪模型降噪频段单一、全频段降噪能力差的问题。The embodiments of the present application provide an image denoising processing method, apparatus and computer equipment to solve the problem that the image denoising model has a single denoising frequency band and poor denoising capability in all frequency bands.
第一方面,本申请实施例提供一种图像降噪处理方法,包括:In a first aspect, an embodiment of the present application provides an image noise reduction processing method, comprising:
根据缩放系数序列缩放原始图像,得到多个缩放图像;缩放系数序列包括多个缩放常数;Scaling the original image according to a scaling coefficient sequence to obtain a plurality of scaled images; the scaling coefficient sequence includes a plurality of scaling constants;
将缩放图像中目标像素点的亮度值执行量化,得到多个与缩放图像对应的量化图像;quantizing the brightness values of target pixels in the scaled image to obtain a plurality of quantized images corresponding to the scaled image;
根据缩放系数序列逆缩放量化图像,得到多个还原图像;Inversely scale the quantized image according to the scaling coefficient sequence to obtain a plurality of restored images;
将多个还原图像输入至预设的图像降噪模型,并获取图像降噪模型输出的多个结果图像;图像降噪模型为根据滤波器构建的降噪模型或根据神经网络构建的降噪模型;Inputting a plurality of restored images into a preset image denoising model, and obtaining a plurality of result images output by the image denoising model; the image denoising model is a denoising model constructed based on a filter or a denoising model constructed based on a neural network;
根据结果图像的降噪效果,确定结果图像的调制系数;Determine a modulation coefficient of the result image according to the noise reduction effect of the result image;
按照调制系数加权组合多个结果图像,得到降噪图像。The multiple result images are weighted and combined according to the modulation coefficient to obtain a denoised image.
在一种可能的实现方式中,根据缩放系数序列缩放原始图像,得到多个缩放图像包括:In a possible implementation, scaling the original image according to the scaling coefficient sequence to obtain a plurality of scaled images includes:
获取待处理图像和预设的缩放系数序列;Obtaining an image to be processed and a preset zoom factor sequence;
将待处理图像中各像素点的亮度值映射至目标区间,得到原始图像;Map the brightness value of each pixel in the image to be processed to the target interval to obtain the original image;
将原始图像中像素点的亮度值分别乘以缩放系数序列中的缩放常数,得到多个缩放图像。The brightness values of the pixels in the original image are multiplied by the scaling constants in the scaling coefficient sequence to obtain multiple scaled images.
在一种可能的实现方式中,目标区间为[0,1]。In one possible implementation, the target interval is [0,1].
在一种可能的实现方式中,将缩放图像中目标像素点的亮度值执行量化包括对目标像素点的亮度值执行向下取整、向上取整、四舍五入中的一种或多种的组合。In a possible implementation, quantizing the brightness value of the target pixel in the scaled image includes performing one or more combinations of rounding down, rounding up, and rounding off on the brightness value of the target pixel.
在一种可能的实现方式中,根据结果图像的降噪效果,确定每个结果图像的调制系数包括:In a possible implementation, determining the modulation coefficient of each result image according to the noise reduction effect of the result image includes:
根据结果图像的降噪效果确定图像降噪模型的降噪频段;Determine the denoising frequency band of the image denoising model according to the denoising effect of the result image;
根据结果图像中像素点的亮度值计算结果图像的噪声频段,并统计噪声频段与降噪频段的重叠频段;The noise frequency band of the result image is calculated according to the brightness value of the pixel points in the result image, and the overlapping frequency bands of the noise frequency band and the noise reduction frequency band are counted;
根据重叠频段占噪声频段的比例,为结果图像分配调制系数。The resulting image is assigned a modulation coefficient based on the proportion of the overlapping frequency band to the noise frequency band.
在一种可能的实现方式中,根据结果图像的降噪效果,确定结果图像的调制系数包括:In a possible implementation, determining the modulation coefficient of the result image according to the noise reduction effect of the result image includes:
计算结果图像的信噪比;Calculate the signal-to-noise ratio of the resulting image;
根据信噪比为结果图像分配调制系数。The resulting image is assigned a modulation coefficient based on the signal-to-noise ratio.
在一种可能的实现方式中,根据结果图像的降噪效果,确定每个结果图像的调制系数包括:In a possible implementation, determining the modulation coefficient of each result image according to the noise reduction effect of the result image includes:
获取原始图像的高清图像;Get high-definition images of the original images;
将高清图像和多个结果图像依次输入至预训练的权重分配模型;权重分配模型为用于根据输入图像的降噪效果分配对应权重系数的神经网络模型;The high-definition image and the multiple result images are sequentially input into a pre-trained weight allocation model; the weight allocation model is a neural network model for allocating corresponding weight coefficients according to the noise reduction effect of the input image;
获取权重分配模型输出的与结果图像对应的调制系数。Get the modulation coefficient corresponding to the result image output by the weight distribution model.
在一种可能的实现方式中,在按照调制系数加权组合多个结果图像,得到降噪图像之后,还包括:In a possible implementation manner, after the plurality of result images are weighted and combined according to the modulation coefficients to obtain the noise-reduced image, the method further includes:
将原始图像输入至图像降噪模型;Input the original image into the image denoising model;
获取图像降噪模型输出的与原始图像对应的原始降噪图像;Obtaining an original denoised image corresponding to the original image output by the image denoising model;
通过线性方式组合原始降噪图像和降噪图像,得到目标降噪图像。The target denoised image is obtained by combining the original denoised image and the denoised image in a linear manner.
第二方面,本申请提供一种图像降噪处理装置,包括:In a second aspect, the present application provides an image noise reduction processing device, comprising:
缩放模块,用于根据缩放系数序列缩放原始图像,得到多个缩放图像;缩放系数序列包括多个常数;A scaling module, used for scaling the original image according to a scaling coefficient sequence to obtain a plurality of scaled images; the scaling coefficient sequence includes a plurality of constants;
量化模块,用于将缩放图像中目标像素点的亮度值执行量化,得到多个与缩放图像对应的量化图像;A quantization module, used to quantize the brightness value of the target pixel in the scaled image to obtain a plurality of quantized images corresponding to the scaled image;
还原模块,用于根据缩放系数序列逆缩放量化图像,得到多个还原图像;A restoration module, used for inversely scaling the quantized image according to the scaling coefficient sequence to obtain a plurality of restored images;
输入模块,用于将多个还原图像输入至预设的图像降噪模型,并获取图像降噪模型输出的多个结果图像;降噪模型为根据滤波器构建的降噪模型或根据神经网络构建的降噪模型;An input module, used to input a plurality of restored images into a preset image denoising model, and obtain a plurality of result images output by the image denoising model; the denoising model is a denoising model constructed based on a filter or a denoising model constructed based on a neural network;
获取模块,用于根据结果图像的降噪效果,确定每个结果图像的调制系数;An acquisition module, used for determining a modulation coefficient of each result image according to a noise reduction effect of the result image;
图像调制模块,用于按照调制系数加权组合多个结果图像,得到降噪图像。The image modulation module is used to weight and combine multiple result images according to the modulation coefficient to obtain a noise-reduced image.
第三方面,本申请提供一种计算机设备,包括存储器和处理器,存储器存储有计算机程序,处理器从存储器中调用并执行计算机程序时实现上述第一方面所述的图像降噪处理方法的步骤。In a third aspect, the present application provides a computer device including a memory and a processor, wherein the memory stores a computer program, and when the processor calls and executes the computer program from the memory, the steps of the image denoising method described in the first aspect are implemented.
第四方面,本申请提供一种计算机存储介质,计算机存储介质上存储有计算机程序,该计算机程序被处理器执行时实现上述第一方面所述的图像降噪处理方法的步骤。In a fourth aspect, the present application provides a computer storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of the image denoising method described in the first aspect above.
第五方面,本申请提供一种计算机程序产品,包括计算机程序,该计算机程序被处理器执行时实现上述第一方面所述的图像降噪处理方法的步骤。In a fifth aspect, the present application provides a computer program product, including a computer program, which, when executed by a processor, implements the steps of the image denoising method described in the first aspect.
通过本申请提供的技术方案,可以根据缩放系数序列缩放待降噪的原始图像,并将缩放后的图像中目标像素点的亮度值量化,再将量化后的图像按照缩放系数序列逆缩放后得到还原图像,将多个还原图像输入图像降噪模型后根据降噪效果可以对模型输出的结果图像进行加权调制,得到最终的降噪图像。这样,通过缩放和量化可以实现对图像信息的频率调整,获得原始图像在不同频段的还原图像,再将多个还原图像的降噪结果调制为降噪图像,可在不改变降噪模型的情况下对不同频段信息降噪,实现动态分频调节图像降噪效果,提高降噪模型的可调性和可应用性。Through the technical solution provided by the present application, the original image to be denoised can be scaled according to the scaling coefficient sequence, and the brightness value of the target pixel in the scaled image can be quantized, and then the quantized image can be inversely scaled according to the scaling coefficient sequence to obtain a restored image. After multiple restored images are input into the image denoising model, the result image output by the model can be weighted modulated according to the denoising effect to obtain the final denoised image. In this way, the frequency of the image information can be adjusted by scaling and quantizing, and the restored images of the original image in different frequency bands can be obtained. Then, the denoising results of the multiple restored images can be modulated into denoised images. The information of different frequency bands can be denoised without changing the denoising model, and the image denoising effect can be adjusted by dynamic frequency division, thereby improving the adjustability and applicability of the denoising model.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
为了更清楚地说明本申请的技术方案,下面将对实施例中所需要使用的附图作简单地介绍,显而易见地,对于本领域普通技术人员而言,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solution of the present application, the drawings required for use in the embodiments are briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.
图1为本申请实施例中提供的一种图像降噪处理方法的流程示意图;FIG1 is a schematic diagram of a process flow of an image noise reduction method provided in an embodiment of the present application;
图2为本申请实施例中一种根据缩放系数序列缩放原始图像的流程示意图;FIG2 is a schematic diagram of a process of scaling an original image according to a scaling coefficient sequence in an embodiment of the present application;
图3为本申请实施例中一种根据结果图像的降噪效果确定调制系数的流程示意图;FIG3 is a schematic diagram of a flow chart of determining a modulation coefficient according to a noise reduction effect of a result image in an embodiment of the present application;
图4为本申请另一实施例中提供的一种根据结果图像的降噪效果确定调制系数的流程示意图;FIG4 is a schematic diagram of a flow chart of determining a modulation coefficient according to a noise reduction effect of a result image provided in another embodiment of the present application;
图5为本申请另一实施例中提供的一种根据结果图像的降噪效果确定调制系数的流程示意图;FIG5 is a schematic diagram of a flow chart of determining a modulation coefficient according to a noise reduction effect of a result image provided in another embodiment of the present application;
图6为本申请另一实施例中提供的一种图像降噪处理方法的流程示意图;FIG6 is a schematic diagram of a flow chart of an image noise reduction method provided in another embodiment of the present application;
图7为本申请实施例中提供的一种图像降噪处理方法的降噪效果对比示意图;FIG7 is a schematic diagram showing a comparison of noise reduction effects of an image noise reduction processing method provided in an embodiment of the present application;
图8为本申请实施例中提供的一种图像降噪处理装置的结构框图;FIG8 is a structural block diagram of an image noise reduction processing device provided in an embodiment of the present application;
图9为本申请实施例中提供的一种计算机设备的结构框图。FIG. 9 is a structural block diagram of a computer device provided in an embodiment of the present application.
具体实施方式Detailed ways
为便于对申请的技术方案进行,以下首先在对本申请所涉及到的一些概念进行说明。To facilitate the technical solution of the application, some concepts involved in the application are first explained below.
需要说明的是,本申请中对于术语的简要说明,仅是为了方便理解接下来描述的实施方式,而不是意图限定本申请的实施方式。除非另有说明,这些术语应当按照其普通和通常的含义理解。It should be noted that the brief description of terms in this application is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their ordinary and common meanings.
本申请中说明书和权利要求书及上述附图中的术语“第一”、“第二”、“第三”等是用于区别类似或同类的对象或实体,而不必然意味着限定特定的顺序或先后次序,除非另外注明。应该理解这样使用的用语在适当情况下可以互换。The terms "first", "second", "third", etc. in the specification and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances.
术语“包括”和“具有”以及他们的任何变形,意图在于覆盖但不排他的包含,例如,包含了一系列组件的产品或设备不必限于清楚地列出的所有组件,而是可包括没有清楚地列出的或对于这些产品或设备固有的其它组件。The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.
目前,处理图像降噪问题主要可以包括两个方向,一种是采用基于滤波器的降噪模型,一种是采用基于神经网络的降噪模型。这两种方法各有优点,滤波器降噪模型更容易与硬件结合,应用更简单,基于神经网络的降噪模型可以通过机器学习获得对某一类型图片更强的降噪能力。At present, there are two main approaches to image denoising: one is to use a filter-based denoising model, and the other is to use a neural network-based denoising model. Both methods have their own advantages. The filter-based denoising model is easier to combine with hardware and is simpler to apply. The neural network-based denoising model can obtain stronger denoising capabilities for a certain type of image through machine learning.
然而,无论是基于滤波器的降噪模型还是基于神经网络的降噪模型,在部署应用上都需要结合硬件设备。由于大多数硬件设备条件限制,一来能够堆叠的滤波器数量有限,二来能够提供的算力资源有限,导致这两种降噪模型都只能将降噪能力偏向一个固定频段,在该固定频段以外降噪效果较差。However, both filter-based and neural network-based noise reduction models need to be combined with hardware devices in their deployment and application. Due to the limitations of most hardware devices, the number of filters that can be stacked is limited, and the computing power resources that can be provided are limited. As a result, both noise reduction models can only bias the noise reduction capability to a fixed frequency band, and the noise reduction effect is poor outside this fixed frequency band.
针对上述技术问题,本申请实施例提供一种图像降噪处理方法、装置及计算机设备,可以提高图像降噪模型的全频段降噪处理能力,增强图像降噪模型的可调性。In response to the above technical problems, the embodiments of the present application provide an image denoising processing method, apparatus and computer equipment, which can improve the full-band denoising processing capability of the image denoising model and enhance the adjustability of the image denoising model.
图1是本申请实施例提供的一种图像降噪处理方法的流程示意图,该处理方法包括:FIG1 is a flow chart of an image noise reduction processing method provided by an embodiment of the present application, wherein the processing method comprises:
步骤S210,根据缩放系数序列缩放原始图像,得到多个缩放图像。Step S210: scaling the original image according to the scaling coefficient sequence to obtain a plurality of scaled images.
其中,缩放系数序列包括多个缩放常数。缩放常数可以为任意正实数,原始图像可以为需要进行降噪处理的图像。在一些实施方式中,缩放常数可以通过读取存储介质或通过与上位机通信获取,也可以随机生成。在一些其他实施方式中,原始图像可以通过读取存储介质或通过与上位机通信获取,也可以通过相机、摄影机等图像采集设备获取。Wherein, the scaling coefficient sequence includes a plurality of scaling constants. The scaling constant can be any positive real number, and the original image can be an image that needs to be subjected to noise reduction processing. In some embodiments, the scaling constant can be obtained by reading a storage medium or by communicating with a host computer, or can be randomly generated. In some other embodiments, the original image can be obtained by reading a storage medium or by communicating with a host computer, or can be obtained by an image acquisition device such as a camera or a video camera.
在一些可能的实现方式中,可以将缩放系数序列中的缩放常数与原始图像中像素点的亮度值相乘,得到缩放图像。例如,如果缩放系数序列中共包括L、M、N三个缩放常数,将原始图像中各像素点的亮度值分别与L相乘,可以得到与L对应的缩放图像,再利用M、N重复同样的操作,最后可以得到分别与L、M、N对应的三个缩放图像。In some possible implementations, the scaling constant in the scaling coefficient sequence may be multiplied by the brightness value of the pixel in the original image to obtain the scaled image. For example, if the scaling coefficient sequence includes three scaling constants L, M, and N, the brightness value of each pixel in the original image is multiplied by L to obtain a scaled image corresponding to L, and then the same operation is repeated using M and N, and finally three scaled images corresponding to L, M, and N are obtained.
步骤S220,将缩放图像中目标像素点的亮度值执行量化,得到多个与缩放图像对应的量化图像。Step S220 , quantizing the brightness values of target pixels in the scaled image to obtain a plurality of quantized images corresponding to the scaled image.
其中,目标像素点可以是缩放图像的全部像素点,也可以是根据预设亮度阈值选取出的像素点。The target pixel points may be all the pixel points of the zoomed image, or may be the pixel points selected according to a preset brightness threshold.
在一些可能的实现方式中,对像素点的亮度值执行量化,可以是对亮度值向下取整,也可以是对亮度值向上取整,还可以是对亮度值进行四舍五入。In some possible implementations, quantization is performed on the brightness value of the pixel point, which may be performed by rounding down the brightness value, rounding up the brightness value, or rounding the brightness value.
在一些其他可能的实现方式中,可以通过设置量化阈值对像素点的亮度值执行不同的量化操作,例如,对高于或等于第一量化阈值的亮度值向下取整,对高于或等于第二量化阈值且低于第一量化阈值的亮度值四舍五入,对高于第三量化阈值且低于第二量化阈值的亮度值向上取整。In some other possible implementations, different quantization operations can be performed on the brightness values of pixel points by setting quantization thresholds, for example, rounding down brightness values that are higher than or equal to the first quantization threshold, rounding up brightness values that are higher than or equal to the second quantization threshold and lower than the first quantization threshold, and rounding up brightness values that are higher than the third quantization threshold and lower than the second quantization threshold.
在一些其他可能的实现方式中,还可以预先设置亮度阈值,亮度值高于或等于亮度阈值的像素点为需要执行量化的目标像素点。In some other possible implementations, a brightness threshold may be preset, and pixels whose brightness values are greater than or equal to the brightness threshold are target pixels that need to be quantized.
步骤S230,根据缩放系数序列逆缩放量化图像,得到多个还原图像。Step S230 , inversely scale the quantized image according to the scaling coefficient sequence to obtain a plurality of restored images.
在一些可能的实现方式中,可以利用缩放系数序列中的多个缩放常数依次对量化图像进行逆运算,例如,可以将缩放常数的倒数与量化图像中像素点的亮度值相乘,得到对应的还原图像。In some possible implementations, multiple scaling constants in the scaling coefficient sequence may be used to sequentially perform inverse operations on the quantized image. For example, the reciprocal of the scaling constant may be multiplied by the brightness value of a pixel in the quantized image to obtain a corresponding restored image.
由于原始图像在缩放后对像素点的亮度值执行了量化,一些像素点的亮度值在量化后发生了改变。这使得原始图像与逆缩放后得到的还原图像虽然具有相同的尺寸,但原始图像中像素点的亮度值与还原图像中像素点的亮度值不同,从而使还原图像具有与原始图像不同的频段。这样,通过缩放、量化、逆缩放的一系列操作,可以得到原始图像在不同频段对应的还原图像。Since the brightness values of the pixels in the original image are quantized after scaling, the brightness values of some pixels change after quantization. This makes the original image and the restored image obtained after inverse scaling have the same size, but the brightness values of the pixels in the original image are different from the brightness values of the pixels in the restored image, so that the restored image has a different frequency band from the original image. In this way, through a series of operations of scaling, quantization, and inverse scaling, the restored images corresponding to the original image in different frequency bands can be obtained.
步骤S240,将多个还原图像输入至预设的图像降噪模型,并获取图像降噪模型输出的多个结果图像。Step S240: input the multiple restored images into a preset image denoising model, and obtain multiple result images output by the image denoising model.
其中,图像降噪模型可以为根据滤波器构建的降噪模型或根据神经网络构建的降噪模型。The image denoising model may be a denoising model constructed based on a filter or a denoising model constructed based on a neural network.
在一些可能的实现方式中,可以将多个还原图像依次输入至图像降噪模型,由图像降噪模型分别对不同的还原图像进行降噪处理,得到多个降噪后的结果图像。In some possible implementations, a plurality of restored images may be sequentially input into an image denoising model, and the image denoising model may perform denoising processing on different restored images respectively to obtain a plurality of denoised result images.
步骤S250,根据结果图像的降噪效果,确定结果图像的调制系数。Step S250: determining a modulation coefficient of the result image according to the noise reduction effect of the result image.
由于图像降噪模型往往只具有对一个固定频段的降噪能力,且即使在该固定频段内不同频率区间的降噪能力也可能存在差异,图像降噪模型对不同还原图像降噪处理后得到的结果图像的降噪效果也是不同的。Since the image denoising model often only has the denoising capability for a fixed frequency band, and even within the fixed frequency band, the denoising capabilities for different frequency intervals may be different, the denoising effects of the resulting images obtained by the image denoising model after denoising different restored images are also different.
在一些可能的实现方式中,可以通过比对不同结果图像的降噪效果为每个结果图像确定一个调制系数,该调制系数用于表示结果图像在后续调制组合过程中所占的权重。可以理解的是,为得到噪声更少的图像,可以为降噪效果较好的结果图像分配较高的调制系数,为降噪效果较差的结果图像分配较低的调制系数。In some possible implementations, a modulation coefficient may be determined for each result image by comparing the noise reduction effects of different result images, and the modulation coefficient is used to represent the weight of the result image in the subsequent modulation combination process. It is understandable that, in order to obtain an image with less noise, a higher modulation coefficient may be assigned to a result image with better noise reduction effect, and a lower modulation coefficient may be assigned to a result image with poor noise reduction effect.
步骤S260,按照调制系数加权组合多个结果图像,得到降噪图像。Step S260: weightedly combine multiple result images according to the modulation coefficients to obtain a denoised image.
在一些可能的实现方式中,可以将每个结果图像与对应的调制系数相乘后再进行叠加,得到综合多个结果图像的降噪图像。In some possible implementations, each result image may be multiplied by a corresponding modulation coefficient and then superimposed to obtain a noise-reduced image that integrates multiple result images.
在上述实施例中,可以根据缩放系数序列缩放待降噪的原始图像,并将缩放后的图像中目标像素点的亮度值量化,再将量化后的图像按照缩放系数序列逆缩放后得到还原图像,将多个还原图像输入图像降噪模型后根据降噪效果可以对模型输出的结果图像进行加权调制,得到最终的降噪图像。这样,通过缩放和量化可以实现对图像信息的频率调整,获得原始图像在不同频段的还原图像,再将多个还原图像的降噪结果调制为降噪图像,可在不改变降噪模型的情况下对不同频段信息降噪,实现动态分频调节图像降噪效果,提高降噪模型的可调性和可应用性。In the above embodiment, the original image to be denoised can be scaled according to the scaling coefficient sequence, and the brightness value of the target pixel in the scaled image can be quantized, and then the quantized image can be inversely scaled according to the scaling coefficient sequence to obtain a restored image, and after multiple restored images are input into the image denoising model, the result image output by the model can be weighted modulated according to the denoising effect to obtain the final denoised image. In this way, the frequency adjustment of the image information can be achieved through scaling and quantization, and the restored images of the original image in different frequency bands can be obtained, and then the denoising results of the multiple restored images can be modulated into denoised images, and the information of different frequency bands can be denoised without changing the denoising model, so as to achieve the dynamic frequency division adjustment image denoising effect, and improve the adjustability and applicability of the denoising model.
图2是本申请实施例中一种根据缩放系数序列缩放原始图像的流程示意图,如图2所示,该过程包括:FIG. 2 is a schematic diagram of a process of scaling an original image according to a scaling coefficient sequence in an embodiment of the present application. As shown in FIG. 2 , the process includes:
步骤S2102,获取待处理图像和预设的缩放系数序列。Step S2102, obtaining an image to be processed and a preset zoom coefficient sequence.
其中,待处理图像可以是需要进行降噪处理的图像。The image to be processed may be an image that needs to be subjected to noise reduction processing.
在一些可能的实现方式中,缩放系数序列包含多个缩放常数,缩放常数可以通过以下方式获得:利用若干随机生成的常数对预先准备的含噪声图像执行上述S210、S220、S230、S240中的步骤,比对不同常数对应的降噪结果,如果某个常数对应的降噪结果中噪声区域相对于含噪声图像变化明显,则可以将该常数作为缩放系数序列的缩放常数。In some possible implementations, the scaling coefficient sequence includes multiple scaling constants, and the scaling constants can be obtained in the following manner: using several randomly generated constants to perform the above steps S210, S220, S230, and S240 on a pre-prepared noisy image, and comparing the denoising results corresponding to different constants; if the noise area in the denoising result corresponding to a certain constant changes significantly relative to the noisy image, then the constant can be used as the scaling constant of the scaling coefficient sequence.
步骤S2104,将待处理图像中各像素点的亮度值映射至目标区间,得到原始图像。Step S2104, mapping the brightness value of each pixel in the image to be processed to the target interval to obtain the original image.
在一些可能的实现方式中,目标区间可以为[0,1]。In some possible implementations, the target interval may be [0, 1].
在一些可能的实现方式中,可以对待处理图像进行归一化处理,将待处理图像中各像素点亮度值的值域范围映射至[0,1],得到值域压缩后的原始图像。In some possible implementations, the image to be processed may be normalized, and the value range of the brightness value of each pixel in the image to be processed may be mapped to [0, 1] to obtain the original image after value range compression.
步骤S2106,将原始图像中像素点的亮度值分别乘以缩放系数序列中的缩放常数,得到多个缩放图像。Step S2106: multiply the brightness values of the pixels in the original image by the scaling constants in the scaling coefficient sequence to obtain a plurality of scaled images.
在一些可能的实现方式中,缩放常数可以是大于1的常数。In some possible implementations, the scaling constant may be a constant greater than 1.
在上述实施例中,通过将待处理图像中像素点亮度值的值域映射至目标区间,可以统一不同图像的亮度值域,减少图像在缩放和量化过程中的信息损失,增强图像降噪处理效果。In the above embodiment, by mapping the value range of the brightness value of the pixel points in the image to be processed to the target interval, the brightness value range of different images can be unified, the information loss of the image during scaling and quantization can be reduced, and the image noise reduction processing effect can be enhanced.
图3是本申请实施例中一种根据结果图像的降噪效果确定调制系数的流程示意图,如图3所示,该过程包括:FIG3 is a schematic diagram of a process for determining a modulation coefficient according to a noise reduction effect of a result image in an embodiment of the present application. As shown in FIG3 , the process includes:
步骤S2501,根据结果图像的降噪效果确定图像降噪模型的降噪频段。Step S2501, determining the denoising frequency band of the image denoising model according to the denoising effect of the result image.
在一些可能的实现方式中,可以统计结果图像与还原图像中相同像素点的亮度变化值,例如可以将结果图像中特征像素点与还原图像中对应像素点的亮度值做差,不同结果图像与还原图像于同一像素点产生的差值中取最高值,将最高值对应于还原图像中像素点的频率作为图像降噪模型的降噪频率,通过设置多个特征像素点可以确定图像降噪模型的降噪频率上限和下限,从而得到降噪频段。由于图像降噪模型对某一固定频段的图像信息进行降噪处理,可以根据结果图像中像素点与还原图像中像素点的亮度变化确定图像降噪模型的降噪频段。In some possible implementations, the brightness change values of the same pixel points in the result image and the restored image can be counted. For example, the brightness values of the characteristic pixel points in the result image and the corresponding pixel points in the restored image can be subtracted, and the highest value is taken from the differences between the different result images and the restored image at the same pixel point. The frequency of the pixel point in the restored image corresponding to the highest value is used as the denoising frequency of the image denoising model. By setting multiple characteristic pixel points, the upper and lower limits of the denoising frequency of the image denoising model can be determined, thereby obtaining the denoising frequency band. Since the image denoising model performs denoising on image information in a fixed frequency band, the denoising frequency band of the image denoising model can be determined according to the brightness change of the pixel points in the result image and the pixel points in the restored image.
步骤S2502,根据结果图像中像素点的亮度值计算结果图像的噪声频段,并统计噪声频段与降噪频段的重叠频段。Step S2502: Calculate the noise frequency band of the result image according to the brightness values of the pixels in the result image, and count the overlapping frequency bands of the noise frequency band and the noise reduction frequency band.
步骤S2503,根据重叠频段占噪声频段的比例,为结果图像分配调制系数。Step S2503, allocating a modulation coefficient to the result image according to the ratio of the overlapping frequency band to the noise frequency band.
在一些可能的实现方式中,重叠频段占噪声频段的比例越高,为结果图像分配的调制系数越大,重叠频段占噪声频段的比例越低,为结果图像分配的调制系数越小。In some possible implementations, the higher the ratio of the overlapping frequency band to the noise frequency band, the larger the modulation coefficient allocated to the result image, and the lower the ratio of the overlapping frequency band to the noise frequency band, the smaller the modulation coefficient allocated to the result image.
在上述实施例中,通过结果图像与还原图像的亮度变化可以确定图像降噪模型的降噪频段,再根据降噪频段与结果图像中噪声频段的重叠比例,可以为比例更高的结果图像分配更大的调制系数,从而可以提升调制后降噪图像的降噪效果。In the above embodiment, the noise reduction frequency band of the image noise reduction model can be determined by the brightness change between the result image and the restored image, and then according to the overlapping ratio of the noise reduction frequency band and the noise frequency band in the result image, a larger modulation coefficient can be allocated to the result image with a higher ratio, thereby improving the noise reduction effect of the denoised image after modulation.
图4是本申请另一实施例中一种根据结果图像的降噪效果确定调制系数的流程示意图,如图4所示,该过程包括:FIG4 is a schematic diagram of a process for determining a modulation coefficient according to a noise reduction effect of a result image in another embodiment of the present application. As shown in FIG4 , the process includes:
步骤S2504,计算结果图像的信噪比。Step S2504, calculating the signal-to-noise ratio of the result image.
在一些可能的实现方式中,可以计算结果图像中所有像素的局部方差,将局部方差的最大值作为信号方差,将局部方差的最小值作为噪声方差,将信号方差与噪声方差的比值作为结果图像的信噪比。In some possible implementations, the local variance of all pixels in the result image may be calculated, the maximum value of the local variance may be taken as the signal variance, the minimum value of the local variance may be taken as the noise variance, and the ratio of the signal variance to the noise variance may be taken as the signal-to-noise ratio of the result image.
步骤S2505,根据信噪比为结果图像分配调制系数。Step S2505: assign a modulation coefficient to the result image according to the signal-to-noise ratio.
在一些可能的实现方式中,结果图像的信噪比越大,为结果图像分配的调制系数越大,信噪比越小,为结果图像分配的调制系数越小。In some possible implementations, the greater the signal-to-noise ratio of the result image, the greater the modulation coefficient allocated to the result image, and the smaller the signal-to-noise ratio, the smaller the modulation coefficient allocated to the result image.
在上述实施例中,通过结果图像中像素点的局部方差可以快速计算图像信噪比,根据信噪比分配结果图像的调制系数,可加快调制进程,提高图像降噪处理效率。In the above embodiment, the image signal-to-noise ratio can be quickly calculated through the local variance of the pixels in the result image, and the modulation coefficient of the result image is allocated according to the signal-to-noise ratio, which can speed up the modulation process and improve the image noise reduction processing efficiency.
图5是本申请另一实施例中一种根据结果图像的降噪效果确定调制系数的流程示意图,如图5所示,该过程包括:FIG5 is a schematic diagram of a process for determining a modulation coefficient according to a noise reduction effect of a result image in another embodiment of the present application. As shown in FIG5 , the process includes:
步骤S2506,获取原始图像的高清图像。Step S2506, obtaining a high-definition image of the original image.
在一些可能的实现方式中,可以对原始图像进行高斯滤波,得到滤波后的高清图像。In some possible implementations, Gaussian filtering may be performed on the original image to obtain a filtered high-definition image.
步骤S2507,将高清图像和多个结果图像依次输入至预训练的权重分配模型。Step S2507, inputting the high-definition image and multiple result images into the pre-trained weight allocation model in sequence.
其中,权重分配模型为用于根据输入图像的降噪效果分配对应权重系数的神经网络模型。Among them, the weight allocation model is a neural network model used to allocate corresponding weight coefficients according to the noise reduction effect of the input image.
在一些可能的实现方式中,可以预先利用含噪声图像和多张去噪后图像作为输入对神经网络模型进行训练,使神经网络模型根据图像降噪效果分配不同的权重系数。In some possible implementations, a noisy image and multiple denoised images may be used as inputs in advance to train a neural network model, so that the neural network model is assigned different weight coefficients according to the image denoising effect.
步骤S2508,获取权重分配模型输出的与结果图像对应的调制系数。Step S2508, obtaining the modulation coefficient corresponding to the result image output by the weight distribution model.
在一些其他实施方式中,在执行上述步骤S2507时,也可以直接将原始图像和多个结果图像输入权重分配模型,获取权重分配模型输出的调制系数。In some other implementations, when executing the above step S2507, the original image and the multiple result images may be directly input into the weight distribution model to obtain the modulation coefficient output by the weight distribution model.
上述实施例中,可以通过预先训练神经网络模型的方式,获得可以用于据输入图像的降噪效果分配对应权重系数的权重分配模型,通过向该权重分配模型中输入结果图像来获取调制系数,可提高图像降噪处理效率。In the above embodiment, a weight allocation model that can be used to allocate corresponding weight coefficients according to the noise reduction effect of the input image can be obtained by pre-training a neural network model. The modulation coefficient is obtained by inputting the result image into the weight allocation model, thereby improving the efficiency of image noise reduction processing.
图6是本申请另一实施例中一种图像降噪处理方法的流程示意图,如图6所示,该过程包括:FIG6 is a flow chart of an image noise reduction processing method in another embodiment of the present application. As shown in FIG6 , the process includes:
步骤S270,将原始图像输入至图像降噪模型。Step S270: input the original image into the image denoising model.
步骤S280,获取图像降噪模型输出的与原始图像对应的原始降噪图像。Step S280, obtaining an original denoised image corresponding to the original image output by the image denoising model.
步骤S290,通过线性方式组合原始降噪图像和降噪图像,得到目标降噪图像。Step S290: combining the original denoised image and the denoised image in a linear manner to obtain a target denoised image.
在一些可能的实现方式中,在得到对多个结果图像调制过的降噪图像后,由于经图像降噪模型处理前的还原图像在缩放和量化过程中可能会损失部分原始图像中的信息,为避免造成信息遗漏,可以将原始图像也输入图像降噪模型,并将原始图像对应的降噪结果与上述调制后的降噪图像进行线性组合,以弥补缩放和量化过程中的信息损失。In some possible implementations, after obtaining a denoised image that is modulated by multiple result images, since the restored image before being processed by the image denoising model may lose some information in the original image during the scaling and quantization process, in order to avoid information omission, the original image can also be input into the image denoising model, and the denoising result corresponding to the original image can be linearly combined with the above-mentioned modulated denoised image to compensate for the information loss during the scaling and quantization process.
为进一步体现本申请方案的有益效果,下面将结合一个具体的实施例进行说明:To further demonstrate the beneficial effects of the present application, a specific embodiment will be described below:
设某一个待降噪图像为X,用于处理该待降噪图像的降噪模型为F。Assume that an image to be denoised is X, and the denoising model used to process the image to be denoised is F.
首先,可以对待降噪图像进行归一化处理,压缩值域范围至[0,1]。First, the image to be denoised can be normalized to compress the value range to [0, 1].
设缩放系数序列C包含n个缩放常数[C1,C2…Cn],对于其中任一缩放常数Ci,其值域范围为Ci>1。将待降噪图像乘以缩放常数后得到缩放后的图像[y1,y2…yn],即:Assume that the scaling coefficient sequence C contains n scaling constants [C 1 , C 2 …C n ], and for any scaling constant C i , its value range is C i > 1. Multiplying the image to be denoised by the scaling constant, we get the scaled image [y 1 , y 2 …y n ], that is:
yi=Ci·Xi yi = Ci · Xi
然后对缩放后的图像应用量化操作,得到量化图像[z1,z2…zn],即:Then, a quantization operation is applied to the scaled image to obtain a quantized image [z 1 , z 2 …z n ], namely:
zi=Quant(yi) zi = Quant( yi )
再对量化图像按照缩放常数逆缩放回原本的归一化数值,可以得到不同频率的还原图像[q1,q2…qn],即:Then, the quantized image is inversely scaled back to the original normalized value according to the scaling constant, and restored images of different frequencies [q 1 , q 2 …q n ] can be obtained, that is:
为体现还原图像的频率是如何相较于待降噪图像发生变化的,这里以待降噪图像中像素点的亮度值变化进行说明:假设在待降噪图像中选取三个像素点来观察,这三个像素点的亮度值为[0.11,0.65,0.11],通过缩放常数将其放大至40倍,亮度值变为[4.4,26,4.4],对放大后的图像亮度值执行向下取整的量化操作,则值变为[4,26,4],再按照缩放常数逆变换回来得到还原图像中像素点的亮度值为[0.1,0.65,0.1],可以看到相比于待降噪图像中的[0.11,0.65,0.11],还原图像中的高频分量更高了,即通过缩放和量化得到了一个整体更高频的还原图像。To show how the frequency of the restored image changes compared to the image to be denoised, the change in the brightness value of the pixels in the image to be denoised is used as an example: suppose three pixels are selected in the image to be denoised for observation, and the brightness values of these three pixels are [0.11, 0.65, 0.11]. The brightness values are amplified to 40 times by the scaling constant, and the brightness values become [4.4, 26, 4.4]. The brightness values of the amplified image are rounded down to [4, 26, 4]. The brightness values are then inversely transformed according to the scaling constant to obtain the brightness values of the pixels in the restored image as [0.1, 0.65, 0.1]. It can be seen that compared with [0.11, 0.65, 0.11] in the image to be denoised, the high-frequency components in the restored image are higher, that is, a restored image with an overall higher frequency is obtained through scaling and quantization.
在得到还原图像后可以将还原图像输入至降噪模型F并得到其输出的结果图像[p1,p2…pn],再根据结果图像分配调制系数。在一些实施方式中,分配调制系数可以通过人工干预或使用神经网络预测的形式来实现。After obtaining the restored image, the restored image can be input into the denoising model F to obtain the output result image [p 1 , p 2 ..p n ], and then the modulation coefficient is allocated according to the result image. In some embodiments, the allocation of the modulation coefficient can be achieved by manual intervention or using a neural network prediction.
最后,根据调制系数可以对结果图像[p1,p2…pn]进行加权组合,得到降噪图像T。Finally, the result images [p 1 , p 2 . . . p n ] can be weighted combined according to the modulation coefficients to obtain the denoised image T.
在一些其他实施方式中,还可以将待降噪图像输入降噪模型F获取对应的原始降噪结果图像Tmp,将降噪图像T与原始降噪结果图像Tmp线性组合弥补量化损失,得到目标降噪图像O,即:In some other implementations, the image to be denoised may be input into the denoising model F to obtain the corresponding original denoising result image Tmp, and the denoised image T and the original denoising result image Tmp may be linearly combined to compensate for the quantization loss, thereby obtaining the target denoised image O, that is:
O=αT+(1-α)TmpO=αT+(1-α)Tmp
上式中,α为大于0小于1的常数。In the above formula, α is a constant greater than 0 and less than 1.
上述实施例的降噪效果可以参见图7,图7中左侧的图像为待降噪图像,中间的图像为仅通过降噪模型对待降噪图像进行降噪处理后的结果,右侧的图像为按照本实施例上述方法调制并线性组合后的结果。如图7所示,由于降噪模型对固定频段进行降噪,使得降噪后结果(中间的图像)整体高频细节丢失严重,而本方法进行分频降噪并调制组合后,由于合理分频降噪频段,使得右侧的图像中矩形区域内的高频细节得到了明显的恢复,整体降噪效果更好。The denoising effect of the above embodiment can be seen in FIG7 , where the image on the left side of FIG7 is the image to be denoised, the image in the middle is the result of denoising the image to be denoised only by the denoising model, and the image on the right side is the result after modulation and linear combination according to the above method of this embodiment. As shown in FIG7 , since the denoising model performs denoising on a fixed frequency band, the overall high-frequency details of the denoised result (the image in the middle) are seriously lost, while after the method performs frequency division denoising and modulation combination, the high-frequency details in the rectangular area of the image on the right are significantly restored due to the reasonable frequency division denoising frequency band, and the overall denoising effect is better.
与前述图像降噪处理方法的实施例相对应,本申请还提供一种图像降噪处理装置300的实施例。如图8所示,该装置包括:Corresponding to the above-mentioned embodiment of the image noise reduction processing method, the present application also provides an embodiment of an image noise reduction processing device 300. As shown in FIG8 , the device includes:
缩放模块310,用于根据缩放系数序列缩放原始图像,得到多个缩放图像;缩放系数序列包括多个常数;A scaling module 310 is used to scale the original image according to a scaling coefficient sequence to obtain a plurality of scaled images; the scaling coefficient sequence includes a plurality of constants;
量化模块320,用于将缩放图像中目标像素点的亮度值执行量化,得到多个与缩放图像对应的量化图像;A quantization module 320, configured to quantize the brightness values of target pixels in the scaled image to obtain a plurality of quantized images corresponding to the scaled image;
还原模块330,用于根据缩放系数序列逆缩放量化图像,得到多个还原图像;Restoration module 330, used for inversely scaling the quantized image according to the scaling coefficient sequence to obtain a plurality of restored images;
输入模块340,用于将多个还原图像输入至预设的图像降噪模型,并获取图像降噪模型输出的多个结果图像;降噪模型为根据滤波器构建的降噪模型或根据神经网络构建的降噪模型;An input module 340 is used to input a plurality of restored images into a preset image denoising model, and obtain a plurality of result images output by the image denoising model; the denoising model is a denoising model constructed based on a filter or a denoising model constructed based on a neural network;
获取模块350,用于根据结果图像的降噪效果,确定每个结果图像的调制系数;An acquisition module 350 is used to determine a modulation coefficient of each result image according to a noise reduction effect of the result image;
图像调制模块360,用于按照调制系数加权组合多个结果图像,得到降噪图像。The image modulation module 360 is used to weight and combine multiple result images according to the modulation coefficient to obtain a noise-reduced image.
关于图像降噪处理装置的具体限定可以参见上文中对于图像降噪处理方法的限定,在此不再赘述。上述图像降噪处理装置中的各个模块可全部或部分通过软件、硬件及其组合来实现。上述各模块可以硬件形式内嵌于或独立于计算机设备中的处理器中,也可以以软件形式存储于计算机设备中的存储器中,以便于处理器调用执行以上各个模块对应的操作。For the specific definition of the image noise reduction processing device, please refer to the definition of the image noise reduction processing method above, which will not be repeated here. Each module in the above-mentioned image noise reduction processing device can be implemented in whole or in part by software, hardware and a combination thereof. The above-mentioned modules can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory of the computer device in the form of software, so that the processor can call and execute the operations corresponding to the above modules.
在一个示例性实施例中,本申请可以利用计算机设备实现上述图像降噪处理方法。In an exemplary embodiment, the present application may utilize a computer device to implement the above-mentioned image noise reduction processing method.
在一种可能的实现方式中,该计算机设备的结构如图9所示,该计算机设备100包括至少一个处理器110、存储器120、通信总线130,以及至少一个通信接口140。In a possible implementation, the structure of the computer device is as shown in FIG. 9 . The computer device 100 includes at least one processor 110 , a memory 120 , a communication bus 130 , and at least one communication interface 140 .
其中,处理器110可以是一个通用中央处理器(Central Processing Unit,CPU)、网络处理器(Network Processor,NP)、微处理器,或者可以是一个或多个用于实现本申请方案的集成电路,例如,专用集成电路(Application-Specific Integrated Circuit,ASIC),可编程逻辑器件(Programmable Logic Device,PLD)或其组合。上述PLD可以是复杂可编程逻辑器件(Complex Programmable Logic Device,CPLD),现场可编程逻辑门阵列(Field-Programmable Gate Array,FPGA),通用阵列逻辑(Generic Array Logic,GAL)或其任意组合。The processor 110 may be a general-purpose central processing unit (CPU), a network processor (NP), a microprocessor, or may be one or more integrated circuits for implementing the solution of the present application, such as an application-specific integrated circuit (ASIC), a programmable logic device (PLD) or a combination thereof. The above-mentioned PLD may be a complex programmable logic device (CPLD), a field programmable gate array (FPGA), a generic array logic (GAL) or any combination thereof.
处理器110可以包括一个或多个CPU。计算机设备100可以包括多个处理器110。这些处理器110中的每一个可以是一个单核处理器(single-CPU),也可以是一个多核处理器(multi-CPU)。需要说明的是,这里的处理器110可以指一个或多个设备、电路和/或用于处理数据(如计算机程序指令)的处理核。The processor 110 may include one or more CPUs. The computer device 100 may include multiple processors 110. Each of these processors 110 may be a single-core processor (single-CPU) or a multi-core processor (multi-CPU). It should be noted that the processor 110 here may refer to one or more devices, circuits and/or processing cores for processing data (such as computer program instructions).
存储器120可以是只读存储器(Read-Only Memory,ROM)或可存储静态信息和指令的其它类型的静态存储设备,也可以是随机存取存储器(Random Access Memory,RAM)或者可存储信息和指令的其它类型的动态存储设备,还可以是电可擦可编程只读存储器(Electrically Erasable Programmable Read-Only Memory,EEPROM)、只读光盘(CompactDisc Read-Only Memory,CD-ROM)或其它光盘存储、光碟存储(包括压缩光碟、激光碟、光碟、数字通用光碟、蓝光光碟等)、磁盘存储介质或者其它磁存储设备,或者是能够用于携带或存储具有指令或数据结构形式的期望的程序代码并能够由计算机存取的任何其它介质,但不限于此。可选地,存储器120可以是独立存在,并通过通信总线130与处理器110相连接;存储器120也可以和处理器110集成在一起。The memory 120 may be a read-only memory (ROM) or other types of static storage devices that can store static information and instructions, or a random access memory (RAM) or other types of dynamic storage devices that can store information and instructions, or an electrically erasable programmable read-only memory (EEPROM), a compact disc (CD-ROM) or other optical disc storage, optical disc storage (including compressed optical disc, laser disc, optical disc, digital versatile disc, Blu-ray disc, etc.), a magnetic disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto. Optionally, the memory 120 may exist independently and be connected to the processor 110 via the communication bus 130; the memory 120 may also be integrated with the processor 110.
通信总线130用于在各组件之间(比如处理器和存储器之间)传送信息,通信总线120可以分为地址总线、数据总线、控制总线等。为便于表示,图1中仅用一条通信总线进行示意,但并不表示仅有一根总线或一种类型的总线。通信接口140用于供该计算机设备100与其它设备或通信网络进行通信。The communication bus 130 is used to transmit information between components (such as between a processor and a memory). The communication bus 120 can be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one communication bus is used in FIG1 , but it does not mean that there is only one bus or one type of bus. The communication interface 140 is used for the computer device 100 to communicate with other devices or communication networks.
通信接口140包括有线通信接口或无线通信接口。其中,有线通信接口例如可以为以太网接口。以太网接口可以是光接口,电接口或其组合。无线通信接口可以为无线局域网(Wireless Local Area Networks,WLAN)接口、蜂窝网络通信接口或其组合等。The communication interface 140 includes a wired communication interface or a wireless communication interface. The wired communication interface may be, for example, an Ethernet interface. The Ethernet interface may be an optical interface, an electrical interface, or a combination thereof. The wireless communication interface may be a wireless local area network (WLAN) interface, a cellular network communication interface, or a combination thereof.
在一些实施例中,存储器120可以用于存储执行本申请方案的计算机程序,处理器110可以执行存储器120中存储的计算机程序。例如,该计算机设备100可以通过处理器110调用并执行存储在存储器120中的计算机程序,以实现本申请实施例提供的图像降噪处理方法的步骤。应该理解的是,本申请提供的图像降噪处理方法,可以应用于图像降噪处理装置,该图像降噪处理装置可以通过软件、硬件或者软硬件结合的方式实现成为处理器110的部分或者全部,集成在计算机设备100中。In some embodiments, the memory 120 can be used to store a computer program for executing the solution of the present application, and the processor 110 can execute the computer program stored in the memory 120. For example, the computer device 100 can call and execute the computer program stored in the memory 120 through the processor 110 to implement the steps of the image denoising processing method provided in the embodiment of the present application. It should be understood that the image denoising processing method provided in the present application can be applied to an image denoising processing device, which can be implemented as part or all of the processor 110 through software, hardware, or a combination of software and hardware, and integrated in the computer device 100.
此外,应该理解的是,本申请实施例可以全部或部分地通过软件、硬件、固件或者其任意结合来实现。当使用软件实现时,可以全部或部分地以计算机程序产品的形式实现。该计算机程序产品包括计算机程序。在计算机设备上加载和运行该计算机程序时,全部或部分地产生按照本申请实施例所示的流程或功能。In addition, it should be understood that the embodiments of the present application can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes a computer program. When the computer program is loaded and run on a computer device, the process or function shown in the embodiments of the present application is generated in whole or in part.
其中,计算机程序可以存储在计算机可读存储介质中,或者从一个计算机可读存储介质向另一个计算机可读存储介质传输,例如,该计算机程序可以从一个网站站点、终端、服务器或数据中心通过有线或无线方式向另一个网站站点、终端、服务器或数据中心进行传输。Among them, the computer program can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer program can be transmitted from one website site, terminal, server or data center to another website site, terminal, server or data center via wired or wireless means.
该计算机可读存储介质可以是计算机设备能够存取的任何可用介质,或者是包含一个或多个可用介质集成的服务器、数据中心等数据存储设备。The computer-readable storage medium may be any available medium that can be accessed by a computer device, or may be a data storage device such as a server or a data center that includes one or more available media.
应该理解的是,以上仅为本申请实施例的具体实施方式而已,并不用于限定本申请实施例的保护范围。凡在本申请实施例的技术方案的基础之上,所做的任何修改、等同替换、改进等,均应包括在本申请实施例的保护范围之内。It should be understood that the above is only a specific implementation of the embodiment of the present application, and is not intended to limit the protection scope of the embodiment of the present application. Any modification, equivalent replacement, improvement, etc. made on the basis of the technical solution of the embodiment of the present application shall be included in the protection scope of the embodiment of the present application.
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202410032321.3A CN118052727B (en) | 2024-01-09 | 2024-01-09 | Image noise reduction processing method and device and computer equipment |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202410032321.3A CN118052727B (en) | 2024-01-09 | 2024-01-09 | Image noise reduction processing method and device and computer equipment |
Publications (2)
Publication Number | Publication Date |
---|---|
CN118052727A true CN118052727A (en) | 2024-05-17 |
CN118052727B CN118052727B (en) | 2025-04-25 |
Family
ID=91043913
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202410032321.3A Active CN118052727B (en) | 2024-01-09 | 2024-01-09 | Image noise reduction processing method and device and computer equipment |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN118052727B (en) |
Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1992791A (en) * | 2005-12-26 | 2007-07-04 | 三星电子株式会社 | Adaptive resolution conversion apparatus for input image and method thereof |
CN103632352A (en) * | 2013-11-01 | 2014-03-12 | 华为技术有限公司 | Method for time domain noise reduction of noise image and related device |
US20170228854A1 (en) * | 2016-02-04 | 2017-08-10 | Thomson Licensing | Method and device for reducing noise in a component of a picture |
CN110060217A (en) * | 2019-04-22 | 2019-07-26 | 杨勇 | A kind of image processing method that noise is effectively reduced |
US20200058104A1 (en) * | 2018-08-14 | 2020-02-20 | Contrast, Inc. | Image processing noise reduction |
CN112991190A (en) * | 2019-12-16 | 2021-06-18 | 荣耀终端有限公司 | Image noise reduction method, medium therefor, and electronic device |
CN114422893A (en) * | 2021-12-28 | 2022-04-29 | 歌尔科技有限公司 | Noise reduction processing method and device, earphone and storage medium |
CN115578258A (en) * | 2022-09-29 | 2023-01-06 | 北京百度网讯科技有限公司 | Image processing method, device, equipment and storage medium |
US20230048097A1 (en) * | 2021-08-13 | 2023-02-16 | Dotphoton Ag | Simultaneous and consistent handling of image data and associated noise model in image processing and image synthesis |
-
2024
- 2024-01-09 CN CN202410032321.3A patent/CN118052727B/en active Active
Patent Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1992791A (en) * | 2005-12-26 | 2007-07-04 | 三星电子株式会社 | Adaptive resolution conversion apparatus for input image and method thereof |
CN103632352A (en) * | 2013-11-01 | 2014-03-12 | 华为技术有限公司 | Method for time domain noise reduction of noise image and related device |
US20170228854A1 (en) * | 2016-02-04 | 2017-08-10 | Thomson Licensing | Method and device for reducing noise in a component of a picture |
US20200058104A1 (en) * | 2018-08-14 | 2020-02-20 | Contrast, Inc. | Image processing noise reduction |
CN110060217A (en) * | 2019-04-22 | 2019-07-26 | 杨勇 | A kind of image processing method that noise is effectively reduced |
CN112991190A (en) * | 2019-12-16 | 2021-06-18 | 荣耀终端有限公司 | Image noise reduction method, medium therefor, and electronic device |
US20230048097A1 (en) * | 2021-08-13 | 2023-02-16 | Dotphoton Ag | Simultaneous and consistent handling of image data and associated noise model in image processing and image synthesis |
CN114422893A (en) * | 2021-12-28 | 2022-04-29 | 歌尔科技有限公司 | Noise reduction processing method and device, earphone and storage medium |
CN115578258A (en) * | 2022-09-29 | 2023-01-06 | 北京百度网讯科技有限公司 | Image processing method, device, equipment and storage medium |
Non-Patent Citations (2)
Title |
---|
V N PRUDHVI RAJ ET AL.: "《Denoising of medical images using image fusion techniques》", 《SIGNAL & IMAGE PROCESSING: AN INTERNATIONAL JOURNAL》, 31 August 2012 (2012-08-31) * |
赵春萍: "《参数自适应的图像去噪算法研究》", 《中国优秀硕士学位论文全文数据库 信息科技辑》, 31 March 2023 (2023-03-31) * |
Also Published As
Publication number | Publication date |
---|---|
CN118052727B (en) | 2025-04-25 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2020093914A1 (en) | Content-weighted deep residual learning for video in-loop filtering | |
CN111383186B (en) | Image processing method and device and terminal equipment | |
CN104751418A (en) | Method and device for image denoising based on 3D block matching | |
CN111784605A (en) | Image denoising method based on region guidance, computer device and computer readable storage medium | |
CN113452378B (en) | Compression method, device and computer readable storage medium for twin data | |
CN112767242A (en) | Image processing method and device based on frequency domain deconvolution and electronic equipment | |
CN114581331A (en) | Point cloud noise reduction method and device suitable for multiple scenes | |
CN113962385A (en) | Neural network training and data processing method and device, medium and computer equipment | |
US20230140865A1 (en) | Image processing method and image processing apparatus | |
CN116091321A (en) | Image scaling method, device, equipment and storage medium | |
CN118052727A (en) | Image noise reduction processing method and device and computer equipment | |
CN118014866A (en) | Image quantization processing method, electronic device, and computer-readable storage medium | |
CN105719258B (en) | The image noise filtering method of minimum cross window intermediate value and mean iterative filtering | |
CN114255179B (en) | Method and device for suppressing noise of earthquake image and electronic equipment | |
CN111160517A (en) | Convolutional layer quantization method and device of deep neural network | |
Hussain et al. | An efficient implementation of neighborhood based wavelet thresholding for image denoising | |
CN113408718B (en) | Device processor selection method, system, terminal device and storage medium | |
CN118656363B (en) | A map coordinate data management method and system applied to digital twin scenes | |
CN114519215B (en) | Data processing method and device suitable for piezoelectric resonator | |
CN119579458B (en) | Image blind deblurring method based on local dual-domain mutual attention and global channel self-attention | |
CN120150675B (en) | Filter coefficient determination method, compensation method, device and equipment for amplitude bandwidth compensation | |
CN117392038B (en) | Medical image histogram equalization method and device, electronic equipment and storage medium | |
CN113052258B (en) | Convolution method, model and computer equipment based on middle layer feature map compression | |
CN114781464A (en) | Data denoising method and device, storage medium and electronic device | |
CN112985781A (en) | Lens test data processing method, device, equipment and storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |