CN107316296B - A method and device for detecting changes in remote sensing images based on logarithmic transformation - Google Patents
A method and device for detecting changes in remote sensing images based on logarithmic transformation Download PDFInfo
- Publication number
- CN107316296B CN107316296B CN201710537712.0A CN201710537712A CN107316296B CN 107316296 B CN107316296 B CN 107316296B CN 201710537712 A CN201710537712 A CN 201710537712A CN 107316296 B CN107316296 B CN 107316296B
- Authority
- CN
- China
- Prior art keywords
- image
- remote sensing
- difference image
- difference
- sensing image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 43
- 230000009466 transformation Effects 0.000 title claims abstract description 31
- 238000001514 detection method Methods 0.000 claims abstract description 54
- 230000008859 change Effects 0.000 claims abstract description 45
- 238000012545 processing Methods 0.000 claims abstract description 27
- 238000001914 filtration Methods 0.000 claims description 17
- 238000004364 calculation method Methods 0.000 claims description 14
- 238000004422 calculation algorithm Methods 0.000 claims description 7
- 238000006243 chemical reaction Methods 0.000 claims description 6
- 230000006870 function Effects 0.000 description 40
- 238000004590 computer program Methods 0.000 description 8
- 238000010586 diagram Methods 0.000 description 8
- 230000008901 benefit Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 238000012544 monitoring process Methods 0.000 description 3
- 230000002085 persistent effect Effects 0.000 description 3
- 230000002123 temporal effect Effects 0.000 description 3
- 238000000684 flow cytometry Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000003672 processing method Methods 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000003064 k means clustering Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000004451 qualitative analysis Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000012549 training Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/23—Clustering techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/30—Noise filtering
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/34—Smoothing or thinning of the pattern; Morphological operations; Skeletonisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/10—Terrestrial scenes
- G06V20/13—Satellite images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10032—Satellite or aerial image; Remote sensing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20024—Filtering details
- G06T2207/20032—Median filtering
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Multimedia (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Evolutionary Computation (AREA)
- Evolutionary Biology (AREA)
- General Engineering & Computer Science (AREA)
- Bioinformatics & Computational Biology (AREA)
- Artificial Intelligence (AREA)
- Astronomy & Astrophysics (AREA)
- Remote Sensing (AREA)
- Life Sciences & Earth Sciences (AREA)
- Quality & Reliability (AREA)
- Image Processing (AREA)
- Image Analysis (AREA)
Abstract
Description
技术领域technical field
本发明涉及图像处理技术领域,尤其涉及一种基于对数变换的遥感图像变化检测方法及装置。The invention relates to the technical field of image processing, in particular to a method and device for detecting changes in remote sensing images based on logarithmic transformation.
背景技术Background technique
随着遥感技术的迅速发展,遥感图像已经在多个领域中得到广泛应用,如土地利用监测、森林监测、城市监测和自然灾害评估分析等。遥感图像的变化检测是指根据同一地区在不同时刻,获取的两幅或多幅遥感图像来确定和分析该地区地表的变化信息。通常情况下,对遥感图像进行变化检测的方法可以分为两类,即监督检测方法和非监督检测方法。其中,监督检测方法是指需要利用分类器训练样本,而后根据训练的样本检测遥感图像的变化区域的方法;非减粗检测方法是指直接对两幅或多幅遥感图像进行检测的方法。然而由于监督检测方法需要获取真实的参考数据,成本较高,因而使得非监督检测方法在实际应用中更加普遍。With the rapid development of remote sensing technology, remote sensing images have been widely used in many fields, such as land use monitoring, forest monitoring, urban monitoring and natural disaster assessment and analysis. The change detection of remote sensing images refers to determining and analyzing the change information of the surface of the region based on two or more remote sensing images obtained at different times in the same region. Generally, the methods of change detection for remote sensing images can be divided into two categories, namely supervised detection methods and unsupervised detection methods. Among them, the supervised detection method refers to the method that needs to use the classifier to train the samples, and then detects the changed area of the remote sensing image according to the training sample; the non-thick detection method refers to the method of directly detecting two or more remote sensing images. However, since supervised detection methods need to obtain real reference data, the cost is high, which makes unsupervised detection methods more common in practical applications.
目前,在使用非监督检测方法进行遥感图像变化检测时,可以通过数据融合和模糊聚类的非监督图像变化检测方法,或者通过PPB去噪和K-means聚类的非监督图像变化检测算法等,虽然提高了遥感图像检测结果的精度,但检测结果的性能指标仍然较低,进而导致遥感图像变化检测准确性较低。At present, when using unsupervised detection methods for remote sensing image change detection, the unsupervised image change detection method of data fusion and fuzzy clustering can be used, or the unsupervised image change detection algorithm of PPB denoising and K-means clustering can be used. , although the accuracy of remote sensing image detection results is improved, the performance indicators of detection results are still low, which in turn leads to low accuracy of remote sensing image change detection.
发明内容SUMMARY OF THE INVENTION
鉴于上述问题,提出了本发明以便提供一种基于对数变换的遥感图像变化检测方法及装置,主要目的是解决现有的非监督图像变化检测方法对遥感图像进行变化检测的检测结果性能指标仍然较低,进而导致遥感图像变化检测准确性较低的问题。In view of the above problems, the present invention is proposed to provide a method and device for detecting changes in remote sensing images based on logarithmic transformation. low, which in turn leads to the problem of low accuracy of remote sensing image change detection.
借由上述技术方案,本发明提供的一种基于对数变换的遥感图像变化检测方法,包括:By the above-mentioned technical scheme, a kind of remote sensing image change detection method based on logarithmic transformation provided by the present invention comprises:
获取第一遥感图像和第二遥感图像;acquiring a first remote sensing image and a second remote sensing image;
分别利用预置第一函数和预置第二函数,根据所述第一遥感图像和所述第二遥感图像,计算第一差异图像和第二差异图像;Using the preset first function and the preset second function respectively, according to the first remote sensing image and the second remote sensing image, calculate the first difference image and the second difference image;
根据所述第一差异图像和所述第二差异图像,计算最终差异图像。A final difference image is calculated from the first difference image and the second difference image.
借由上述技术方案,本发明提供的一种基于对数变换的遥感图像变化检测装置,包括:By the above-mentioned technical scheme, a kind of remote sensing image change detection device based on logarithmic transformation provided by the present invention comprises:
获取单元,用于获取第一遥感图像和第二遥感图像;an acquisition unit for acquiring the first remote sensing image and the second remote sensing image;
计算单元,用于分别利用预置第一函数和预置第二函数,根据所述第一遥感图像和所述第二遥感图像,计算第一差异图像和第二差异图像;a computing unit, configured to calculate a first difference image and a second difference image according to the first remote sensing image and the second remote sensing image by using the preset first function and the preset second function respectively;
所述计算单元,还用于根据所述第一差异图像和所述第二差异图像,计算最终差异图像。The calculating unit is further configured to calculate a final difference image according to the first difference image and the second difference image.
本发明实施例提供的一种基于对数变换的遥感图像变化检测方法及装置,与现有的通过非监督图像变化检测方法对遥感图像进行变化检测相比,本发明实施例通过获取同一地区两个不同时相分别对应的遥感图像,并根据获取到的两幅遥感图像,利用两个预置函数分别计算得到两个不同的差异图像,再根据得到的两个差异图像计算最终的差异图像,提高了检测结果的性能指标,进而提高了遥感图像变化检测的准确性。The method and device for detecting changes in remote sensing images based on logarithmic transformation provided by the embodiments of the present invention, compared with the existing methods for detecting changes in remote sensing images through unsupervised image changes, the embodiments of the present invention obtain two two remote sensing images corresponding to different time phases, and according to the obtained two remote sensing images, use two preset functions to calculate two different difference images respectively, and then calculate the final difference image according to the two obtained difference images, The performance index of the detection result is improved, thereby improving the accuracy of remote sensing image change detection.
上述说明仅是本发明技术方案的概述,为了能够更清楚了解本发明的技术手段,而可依照说明书的内容予以实施,并且为了让本发明的上述和其它目的、特征和优点能够更明显易懂,以下特举本发明的具体实施方式。The above description is only an overview of the technical solutions of the present invention, in order to be able to understand the technical means of the present invention more clearly, it can be implemented according to the content of the description, and in order to make the above and other purposes, features and advantages of the present invention more obvious and easy to understand , the following specific embodiments of the present invention are given.
附图说明Description of drawings
通过阅读下文优选实施方式的详细描述,各种其他的优点和益处对于本领域普通技术人员将变得清楚明了。附图仅用于示出优选实施方式的目的,而并不认为是对本发明的限制。而且在整个附图中,用相同的参考符号表示相同的部件。在附图中:Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are for the purpose of illustrating preferred embodiments only and are not to be considered limiting of the invention. Also, the same components are denoted by the same reference numerals throughout the drawings. In the attached image:
图1示出了发明实施例提供的一种基于对数变换的遥感图像变化检测方法的流程图;1 shows a flowchart of a method for detecting changes in remote sensing images based on logarithmic transformation provided by an embodiment of the invention;
图2示出了发明实施例提供的另一种基于对数变换的遥感图像变化检测方法的流程图;2 shows a flowchart of another method for detecting changes in remote sensing images based on logarithmic transformation provided by an embodiment of the invention;
图3示出了发明实施例提供的一种基于对数变换的遥感图像变化检测装置的方框图;3 shows a block diagram of a logarithmic transformation-based remote sensing image change detection device provided by an embodiment of the invention;
图4示出了发明实施例提供的另一种基于对数变换的遥感图像变化检测装置的方框图。FIG. 4 shows a block diagram of another remote sensing image change detection device based on logarithmic transformation provided by an embodiment of the present invention.
具体实施方式Detailed ways
下面将参照附图更详细地描述本公开的示例性实施例。虽然附图中显示了本公开的示例性实施例,然而应当理解,可以以各种形式实现本公开而不应被这里阐述的实施例所限制。相反,提供这些实施例是为了能够更透彻地理解本公开,并且能够将本公开的范围完整的传达给本领域的技术人员。Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided so that the present disclosure will be more thoroughly understood, and will fully convey the scope of the present disclosure to those skilled in the art.
本发明实施例提供一种基于对数变换的遥感图像变化检测方法,如图1所示,所述方法包括:An embodiment of the present invention provides a method for detecting changes in remote sensing images based on logarithmic transformation. As shown in FIG. 1 , the method includes:
101、获取第一遥感图像和第二遥感图像。101. Acquire a first remote sensing image and a second remote sensing image.
其中,所述第一遥感图像和第二遥感图像为同一地区两个不同时相分别对应的遥感图像,而所述遥感图像可以为SAR(Synthetic Aperture Radar,合成孔径雷达)图像。The first remote sensing image and the second remote sensing image are remote sensing images corresponding to two different time phases in the same area, and the remote sensing image may be a SAR (Synthetic Aperture Radar, synthetic aperture radar) image.
例如,获取到第一遥感图像为地区A在时相1时的SAR图像为X1,X1={X1(i,j),1<i<m,1<j<n},获取到第二遥感图像为地区A在时相2时的SAR图像为X2,X2={X2(i,j),1<i<m,1<j<n},X1和X2均为m像素×n像素的SAR图像。For example, the obtained first remote sensing image is that the SAR image of region A at time phase 1 is X 1 , X 1 ={X 1 (i,j), 1<i<m, 1<j<n}, and the obtained The second remote sensing image is the SAR image of region A at time phase 2, X 2 , X 2 ={X 2 (i, j), 1<i<m, 1<j<n}, X 1 and X 2 are both is an m pixel × n pixel SAR image.
102、分别利用预置第一函数和预置第二函数,根据所述第一遥感图像和所述第二遥感图像,计算第一差异图像和第二差异图像。102. Calculate a first difference image and a second difference image according to the first remote sensing image and the second remote sensing image by using a preset first function and a preset second function, respectively.
其中,所述预置第一函数可以为差值函数,所述第二预置函数可以为对数比值函数,例如,如所述步骤101中获取到的第一遥感图像X1和第二遥感图像X2,则具体的利用差值函数和对数比值函数计算差异图像可以如下所示:Wherein, the preset first function may be a difference function, and the second preset function may be a logarithmic ratio function, for example, the first remote sensing image X 1 and the second remote sensing image obtained in
第一差异图像为F1(i,j)=|X1(i,j)-X2(i,j)|,第二差异图像为需要说明的是,式中,用G1(i,j)+1代替G1(i,j),用G2(i,j)+1代替G2(i,j)以避免出现Gi(i=1,2)像素值为0的情况。The first difference image is F 1 (i, j)=|X 1 (i, j)-X 2 (i, j)|, and the second difference image is It should be noted that, in the formula, G 1 (i, j)+1 is used to replace G 1 (i, j), and G 2 (i, j)+1 is used to replace G 2 (i, j) to avoid the occurrence of G i (i=1, 2) The case where the pixel value is 0.
103、根据所述第一差异图像和所述第二差异图像,计算最终差异图像。103. Calculate a final difference image according to the first difference image and the second difference image.
其中,所述最终差异图像为表示所述两个不同时相之间的变化区域图像。Wherein, the final difference image is an image representing the change area between the two different time phases.
具体地,所述步骤103可以为分别对第一差异图像和第二差异图像分配权重,而后根据两幅差异图像和分别对应的权重计算最终差异图像。Specifically, the
对于本发明实施例,通过获取同一地区两个时相的遥感图像,并根据得到的两时相遥感图像进行处理、定性分析、计算等操作,最终得到差异遥感图像,即两时相之间的变化区域的图像,完成对遥感图像的变化检测。For the embodiment of the present invention, by acquiring remote sensing images of two temporal phases in the same area, and performing operations such as processing, qualitative analysis, and calculation according to the obtained remote sensing images of two temporal phases, a difference remote sensing image is finally obtained, that is, the difference between the two temporal phases. The image of the changed area is completed to detect the change of the remote sensing image.
本发明实施例提供的一种基于对数变换的遥感图像变化检测方法,与现有的通过非监督图像变化检测方法对遥感图像进行变化检测相比,本发明实施例通过获取同一地区两个不同时相分别对应的遥感图像,并根据获取到的两幅遥感图像,利用两个预置函数分别计算得到两个不同的差异图像,再根据得到的两个差异图像计算最终的差异图像,提高了检测结果的性能指标,进而提高了遥感图像变化检测的准确性。A method for detecting changes in remote sensing images based on logarithmic transformation provided by an embodiment of the present invention, compared with the existing method for detecting changes in remote sensing images through unsupervised image change detection, the embodiment of the present invention obtains two different changes in the same area by acquiring At the same time, the corresponding remote sensing images are compared, and two different difference images are calculated by using two preset functions according to the two obtained remote sensing images, and then the final difference image is calculated according to the obtained two difference images, which improves the The performance indicators of the detection results, thereby improving the accuracy of remote sensing image change detection.
本发明实施例还提供了另一种基于对数变换的遥感图像变化检测方法,如图2所示,所述方法包括:The embodiment of the present invention also provides another method for detecting changes in remote sensing images based on logarithmic transformation, as shown in FIG. 2 , the method includes:
201、获取第一遥感图像和第二遥感图像。201. Acquire a first remote sensing image and a second remote sensing image.
其中,所述第一遥感图像和第二遥感图像为同一地区两个不同时相分别对应的遥感图像。Wherein, the first remote sensing image and the second remote sensing image are remote sensing images corresponding to two different time phases in the same area.
本步骤与图1所示的步骤101方法相同,在此不再赘述。This step is the same as the method of
202、对所述第一遥感图像和所述第二遥感图像分别进行对数转换。202. Perform logarithmic transformation on the first remote sensing image and the second remote sensing image respectively.
进一步地,得到与所述第一遥感图像对应的基于对数域第一图像和与所述第二遥感图像对应的基于对数域第二图像。其中,所述对数转换可以为以2为底数的对数运算。Further, a first image based on logarithmic domain corresponding to the first remote sensing image and a second image based on logarithmic domain corresponding to the second remote sensing image are obtained. Wherein, the logarithmic conversion may be a logarithmic operation with a base of 2.
具体地,所述步骤202可以如下所示:Specifically, the
U1(i,j)=lb(X1(i,j)+1),U2(i,j)=lb(X2(i,j)+1),其中,X1和X2分别为两个不同时相的遥感图像,U1和U2分别表示对遥感图像进行对数转换后得到的基于对数域图像。需要说明的是,式中,用X1(i,j)+1代替X1(i,j),X2(i,j)+1代替X2(i,j),以避免出现Xi(i=1,2)像素值为0的情况。U 1 (i, j)=lb(X 1 (i, j)+1), U 2 (i, j)=lb(X 2 (i, j)+1), where X 1 and X 2 are respectively are two remote sensing images of different time phases, U 1 and U 2 respectively represent images based on logarithmic domain obtained by logarithmic transformation of remote sensing images. It should be noted that, in the formula, X 1 (i, j)+1 is used to replace X 1 (i, j), and X 2 (i, j)+1 is used to replace X 2 (i, j) to avoid the occurrence of X i (i=1, 2) The case where the pixel value is 0.
对于本发明实施例,通过对获取到的遥感图像进行对数转换,使得遥感图像转换为对数域图像,从而可以把遥感图像的灰度值压缩至[0,8]之间的同时,将遥感图像中的噪声进行压缩,进而实现了对遥感图像进行去噪,提高了遥感图像变化检测的精度。For the embodiment of the present invention, by performing logarithmic conversion on the obtained remote sensing image, the remote sensing image is converted into a logarithmic domain image, so that the gray value of the remote sensing image can be compressed to be between [0, 8], and the The noise in the remote sensing image is compressed, which realizes the denoising of the remote sensing image and improves the accuracy of the change detection of the remote sensing image.
203、对所述基于对数域第一图像和所述基于对数域第二图像进行去噪处理。203. Perform denoising processing on the first image based on the logarithmic domain and the second image based on the logarithmic domain.
进一步地,分别得到去噪后第一图像和去噪后第二图像。具体地,所述步骤203可以为通过Frost滤波器对经过对数转换得到的基于对数域的图像进行去噪。Further, the first image after denoising and the second image after denoising are obtained respectively. Specifically, the
对于本发明实施例,通过利用Frost滤波器对基于对数域的图像进行去噪,可以在平滑噪声的同时保留图像边缘信息,使得去噪后的遥感图像更加准确,从而提高了遥感图像变化检测的准确率。For the embodiment of the present invention, by using the Frost filter to denoise the image based on the logarithmic domain, the edge information of the image can be preserved while the noise is smoothed, so that the denoised remote sensing image is more accurate, thereby improving the detection of changes in the remote sensing image. 's accuracy.
204、分别利用预置第一函数和预置第二函数,根据所述去噪后第一图像和所述去噪后第二图像,计算第一差异图像和第二差异图像。204. Calculate a first difference image and a second difference image according to the first image after denoising and the second image after denoising by using the preset first function and the preset second function respectively.
其中,所述预置第一函数可以为差值函数,所述第二预置函数可以为对数比值函数,具体的概念解释可以参考步骤102中相应描述,在此不再赘述。The preset first function may be a difference function, and the second preset function may be a logarithmic ratio function. For specific concept explanations, refer to the corresponding description in
需要说明的是,通过将基于对数域的图像进行去噪后并采用差值操作,能够在一定程度上消除相干斑噪声的影响,通过将基于对数域的图像进行去噪后并采用对数比值操作,可以提高变化区域的辨识度,抑制非变化区域的背景信息,因为使得图像有更强的鲁棒性,提高了遥感图像变化检测的精确度。It should be noted that the influence of speckle noise can be eliminated to a certain extent by denoising the image based on the logarithmic domain and using the difference operation. The numerical ratio operation can improve the identification of the changed area and suppress the background information of the non-changed area, because it makes the image more robust and improves the accuracy of remote sensing image change detection.
205、对所述第一差异图像和所述第二差异图像分别进行滤波处理。205. Perform filtering processing on the first difference image and the second difference image respectively.
进一步地,得到滤波后第一差异图像和滤波后第二差异图像。其中,所述滤波处理可以为均值滤波器处理,也可以为中值滤波器处理,对第一差异图像和第二差异图像可以为相同的滤波处理方法,也可以为不同的滤波处理方法,本发明实施例不做具体限定。Further, the filtered first difference image and the filtered second difference image are obtained. Wherein, the filtering processing may be mean value filtering processing or median filtering processing, and may be the same filtering processing method or different filtering processing methods for the first difference image and the second difference image. The embodiments of the invention are not specifically limited.
206、根据所述滤波后第一差异图像和所述滤波后第二差异图像,计算最终差异图像。206. Calculate a final difference image according to the filtered first difference image and the filtered second difference image.
具体地,对于本发明实施例,所述步骤206具体可以包括:将所述滤波后第一差异图像和所述滤波后第二差异图像分别配置第一权重系数和第二权重系数;分别计算所述第一权重系数和所述第一差异图像的乘积,以及所述第二权重系数和所述第二差异遥感图像的乘积,得到第一乘积和第二乘积;将所述第一乘积和所述第二乘积相加的和值,确定为最终差异遥感图像。需要说明的是,为了确保最终差异图像的灰度值仍置于0到8之间,所述第一权重系数和所述第二权重系数之和为1。Specifically, for the embodiment of the present invention, the
对于本发明实施例,具体的应用场景可以如下所示,但不限于此,包括:For this embodiment of the present invention, specific application scenarios may be as follows, but are not limited thereto, including:
获取第一遥感图像X1和第二遥感图像X2,对遥感图像X1和X2进行对数转换,得到基于对数域的图像U1和U2,而后对图像U1和U2进行去噪,得到去噪后的图像G1和G2,根据图像G1利用差值法计算得到第一差异图像为F1,根据图像G2利用对数比值法计算得到第二差异图像为F2,而后通过均值滤波器对第一差异图像F1进行滤波处理,得到滤波后第一差异图像D1,通过中值滤波器对第二差异图像F2进行滤波处理,得到滤波后第而差异图像D2,为了平衡平滑图像且保留图像细节,可以将第一权重系数和第二权重系数设置为相等的数值,即均为0.5,此时可以计算得到最终的差异遥感图像R(i,j)为:Obtain the first remote sensing image X 1 and the second remote sensing image X 2 , perform logarithmic transformation on the remote sensing images X 1 and X 2 to obtain images U 1 and U 2 based on the logarithmic domain, and then perform a logarithmic transformation on the images U 1 and U 2 Denoising to obtain denoised images G 1 and G 2 , the first difference image is F 1 calculated by the difference method according to the image G 1 , and the second difference image F is calculated by the logarithmic ratio method according to the image G 2 2 , and then filter the first difference image F1 through the mean filter to obtain the filtered first difference image D1, and filter the second difference image F2 through the median filter to obtain the first difference after filtering. In the image D 2 , in order to balance the smooth image and preserve the image details, the first weight coefficient and the second weight coefficient can be set to the same value, that is, both are 0.5, at this time, the final difference remote sensing image R(i, j can be calculated )for:
R(i,j)=0.5D1(i,j)+0.5D2(i,j)。R(i,j)= 0.5D1 (i,j)+ 0.5D2 (i,j).
207、利用预置聚类算法对所述最终差异遥感图像进行聚类。207. Use a preset clustering algorithm to cluster the final difference remote sensing image.
其中,所述预置聚类算法可以为FCM(Flow Cytometry/financal capacitymodel,流式细胞术)聚类算法。The preset clustering algorithm may be an FCM (Flow Cytometry/financal capacity model, flow cytometry) clustering algorithm.
具体地,所述步骤207可以为通过最小化目标函数Jm找到给定数据的模糊聚类,最小化目标函数Jm为:Specifically, the
式中Y=(y1,y2,...,yn)是一组n维数据样本,Z=(z1,z2,...,zn)是模糊组I的聚类中心,U=[uij]c×n是Y的隶属度矩阵,uij∈[0,1]是yi属于第i类的隶属度,||yj-zi||为第i个聚类中心与第j个数据点间的欧几里德距离,且m∈(1,∞]是一个加权指数,而后通过拉格朗日乘子可以得到Jm达到最小值时的必要条件 where Y=(y 1 , y 2 ,..., y n ) is a group of n-dimensional data samples, Z=(z 1 , z 2 ,..., z n ) is the cluster center of fuzzy group I , U=[u ij ] c×n is the membership degree matrix of Y, u ij ∈[0, 1] is the membership degree of yi belonging to the ith class, ||y j -z i || is the ith cluster The Euclidean distance between the class center and the jth data point, and m∈(1, ∞] is a weighted exponent, and then the necessary condition for J m to reach the minimum value can be obtained through the Lagrange multiplier
和进行迭代,得到最优的聚类结果。and Iterate to get the best clustering result.
本发明实施例提供的另一种基于对数变换的遥感图像变化检测方法,与现有的通过非监督图像变化检测方法对遥感图像进行变化检测相比,本发明实施例通过获取同一地区两个不同时相的遥感图像之后,对两幅遥感图像进行对数转换,并进行去噪处理,而后利用差值函数和对数比值函数对两幅去噪后的图像分别计算差异图像,并对差异图像进行滤波处理后,根据配置的权重系数计算最终的差异遥感图像,提高了检测结果的性能指标,进而提高了遥感图像变化检测的准确性。Another method for detecting changes in remote sensing images based on logarithmic transformation provided by the embodiment of the present invention, compared with the existing method for detecting changes in remote sensing images through unsupervised image change detection, the embodiment of the present invention obtains two After remote sensing images of different time phases, logarithmically transform the two remote sensing images and perform denoising processing, and then use the difference function and the logarithm ratio function to calculate the difference images respectively for the two denoised images, and compare the differences. After the image is filtered, the final difference remote sensing image is calculated according to the configured weight coefficient, which improves the performance index of the detection result, and further improves the accuracy of remote sensing image change detection.
进一步地,作为图1所示方法的具体实现,本发明实施例提供一种基于对数变换的遥感图像变化检测装置,如图3所示,所述装置可以包括:获取单元31、计算单元32。Further, as a specific implementation of the method shown in FIG. 1 , an embodiment of the present invention provides a remote sensing image change detection device based on logarithmic transformation. As shown in FIG. 3 , the device may include: an
获取单元31,用于获取第一遥感图像和第二遥感图像;所述获取单元31为一种基于对数变换的遥感图像变化检测装置执行获取第一遥感图像和第二遥感图像的功能模块。The acquiring
计算单元32,用于分别利用预置第一函数和预置第二函数,根据所述第一遥感图像和所述第二遥感图像,计算第一差异图像和第二差异图像;所述计算单元32为一种基于对数变换的遥感图像变化检测装置执行计算第一差异图像和第二差异图像的功能模块。The
所述计算单元32,还可以用于根据所述第一差异图像和所述第二差异图像,计算最终差异图像;所述计算单元32为一种基于对数变换的遥感图像变化检测装置执行计算最终差异图像的功能模块。The
该装置实施例与前述方法实施例对应,为便于阅读,本装置实施例不再对前述方法实施例中的细节内容进行逐一赘述,但应当明确,本实施例中的装置能够对应实现前述方法实施例中的全部内容。This apparatus embodiment corresponds to the foregoing method embodiments. For ease of reading, this apparatus embodiment will not repeat the details in the foregoing method embodiments one by one, but it should be clear that the apparatus in this embodiment can correspondingly implement the foregoing method embodiments. the entire contents of the example.
本发明实施例提供的一种基于对数变换的遥感图像变化检测装置,与现有的通过非监督图像变化检测方法对遥感图像进行变化检测相比,本发明实施例通过获取同一地区两个不同时相分别对应的遥感图像,并根据获取到的两幅遥感图像,利用两个预置函数分别计算得到两个不同的差异图像,再根据得到的两个差异图像计算最终的差异图像,提高了检测结果的性能指标,进而提高了遥感图像变化检测的准确性。A method for detecting changes in remote sensing images based on logarithmic transformation provided by the embodiment of the present invention, compared with the existing method for detecting changes in remote sensing images through unsupervised image change detection, the embodiment of the present invention obtains two different images in the same area by acquiring At the same time, the corresponding remote sensing images are compared, and two different difference images are calculated by using two preset functions according to the two obtained remote sensing images, and then the final difference image is calculated according to the obtained two difference images, which improves the The performance indicators of the detection results, thereby improving the accuracy of remote sensing image change detection.
进一步地,作为图2所示方法的具体实现,本发明实施例提供另一种基于对数变换的遥感图像变化检测装置,如图4所示,所述装置可以包括:获取单元41、计算单元42。Further, as a specific implementation of the method shown in FIG. 2 , an embodiment of the present invention provides another remote sensing image change detection device based on logarithmic transformation. As shown in FIG. 4 , the device may include: an
获取单元41,用于获取第一遥感图像和第二遥感图像;an
计算单元42,用于分别利用预置第一函数和预置第二函数,根据所述第一遥感图像和所述第二遥感图像,计算第一差异图像和第二差异图像;The
所述计算单元42,还用于根据所述第一差异图像和所述第二差异图像,计算最终差异图像。The calculating
进一步地,所述装置还包括:转换单元43,去噪单元44。Further, the apparatus further includes: a converting
所述转换单元43,用于对所述第一遥感图像和所述第二遥感图像分别进行对数转换。The
所述去噪单元44,用于对所述基于对数域第一图像和所述基于对数域第二图像进行去噪处理。The
进一步地,所述计算单元42,具体用于分别利用预置第一函数和预置第二函数,根据所述去噪后第一图像和所述去噪后第二图像,计算第一差异图像和第二差异图像。Further, the
进一步地,所述装置还包括:滤波单元45。Further, the apparatus further includes: a filtering
所述滤波单元45,用于对所述第一差异图像和所述第二差异图像分别进行滤波处理。The
进一步地,所述计算单元42,具体还用于根据所述滤波后第一差异图像和所述滤波后第二差异图像,计算最终差异图像。Further, the calculating
具体地,为了提高遥感图像变化检测的准确性,所述计算单元42包括:Specifically, in order to improve the accuracy of remote sensing image change detection, the
配置模块4201,用于将所述滤波后第一差异图像和所述滤波后第二差异图像分别配置第一权重系数和第二权重系数;A
计算模块4202,用于分别计算所述第一权重系数和所述第一差异图像的乘积,以及所述第二权重系数和所述第二差异遥感图像的乘积,得到第一乘积和第二乘积;A
确定模块4203,用于将所述第一乘积和所述第二乘积相加的和值,确定为最终差异遥感图像。The determining
进一步地,所述装置还包括:聚类单元46。Further, the apparatus further includes: a
所述聚类单元46,用于利用预置聚类算法对所述最终差异遥感图像进行聚类。The
该装置实施例与前述方法实施例对应,为便于阅读,本装置实施例不再对前述方法实施例中的细节内容进行逐一赘述,但应当明确,本实施例中的装置能够对应实现前述方法实施例中的全部内容。This apparatus embodiment corresponds to the foregoing method embodiments. For ease of reading, this apparatus embodiment will not repeat the details in the foregoing method embodiments one by one, but it should be clear that the apparatus in this embodiment can correspondingly implement the foregoing method embodiments. the entire contents of the example.
本发明实施例提供的另一种基于对数变换的遥感图像变化检测装置,与现有的通过非监督图像变化检测方法对遥感图像进行变化检测相比,本发明实施例通过获取同一地区两个不同时相的遥感图像之后,对两幅遥感图像进行对数转换,并进行去噪处理,而后利用差值函数和对数比值函数对两幅去噪后的图像分别计算差异图像,并对差异图像进行滤波处理后,根据配置的权重系数计算最终的差异遥感图像,提高了检测结果的性能指标,进而提高了遥感图像变化检测的准确性。Another method for detecting changes in remote sensing images based on logarithmic transformation provided by the embodiment of the present invention, compared with the existing method for detecting changes in remote sensing images through unsupervised image change detection, the embodiment of the present invention obtains two After remote sensing images of different time phases, logarithmically transform the two remote sensing images and perform denoising processing, and then use the difference function and the logarithm ratio function to calculate the difference images respectively for the two denoised images, and compare the differences. After the image is filtered, the final difference remote sensing image is calculated according to the configured weight coefficient, which improves the performance index of the detection result, and further improves the accuracy of remote sensing image change detection.
所述基于对数变换的遥感图像变化检测装置包括处理器和存储器,上述获取单元、计算单元等均作为程序单元存储在存储器中,由处理器执行存储在存储器中的上述程序单元来实现相应的功能。The remote sensing image change detection device based on logarithmic transformation includes a processor and a memory, and the above-mentioned acquisition unit, calculation unit, etc. are all stored in the memory as program units, and the processor executes the above-mentioned program units stored in the memory to realize corresponding. Function.
处理器中包含内核,由内核去存储器中调取相应的程序单元。内核可以设置一个或以上,通过调整内核参数来解决现有的非监督图像变化检测方法对遥感图像进行变化检测的检测结果性能指标仍然较低,进而导致遥感图像变化检测准确性较低的问题。The processor includes a kernel, and the kernel calls the corresponding program unit from the memory. One or more kernels can be set. By adjusting the kernel parameters, the existing unsupervised image change detection methods for remote sensing image change detection still have low performance indicators, which leads to the problem of low accuracy of remote sensing image change detection.
存储器可能包括计算机可读介质中的非永久性存储器,随机存取存储器(RAM)和/或非易失性内存等形式,如只读存储器(ROM)或闪存(flash RAM),存储器包括至少一个存储芯片。Memory may include non-persistent memory in computer readable media, random access memory (RAM) and/or non-volatile memory, such as read only memory (ROM) or flash memory (flash RAM), the memory including at least one memory chip.
本申请还提供了一种计算机程序产品,当在数据处理设备上执行时,适于执行初始化有如下方法步骤的程序代码:获取第一遥感图像和第二遥感图像,所述第一遥感图像和第二遥感图像为两个不同时相分别对应的遥感图像;分别利用预置第一函数和预置第二函数,根据所述第一遥感图像和所述第二遥感图像,计算第一差异图像和第二差异图像;根据所述第一差异图像和所述第二差异图像,计算最终差异图像,所述最终差异图像为表示所述两个不同时相之间的变化区域图像。The present application also provides a computer program product, which, when executed on a data processing device, is adapted to execute a program code initialized with the following method steps: acquiring a first remote sensing image and a second remote sensing image, the first remote sensing image and the The second remote sensing image is two remote sensing images corresponding to different time phases respectively; the first difference image is calculated according to the first remote sensing image and the second remote sensing image by using the preset first function and the preset second function respectively. and a second difference image; according to the first difference image and the second difference image, a final difference image is calculated, and the final difference image is an image representing a change area between the two different phases.
本领域内的技术人员应明白,本申请的实施例可提供为方法、系统、或计算机程序产品。因此,本申请可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且,本申请可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。As will be appreciated by those skilled in the art, the embodiments of the present application may be provided as a method, a system, or a computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.
本申请是参照根据本申请实施例的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器,使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the present application. It will be understood that each flow and/or block in the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to the processor of a general purpose computer, special purpose computer, embedded processor or other programmable data processing device to produce a machine such that the instructions executed by the processor of the computer or other programmable data processing device produce Means for implementing the functions specified in a flow or flow of a flowchart and/or a block or blocks of a block diagram.
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中,使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品,该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory result in an article of manufacture comprising instruction means, the instructions The apparatus implements the functions specified in the flow or flow of the flowcharts and/or the block or blocks of the block diagrams.
这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上,使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理,从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。These computer program instructions can also be loaded on a computer or other programmable data processing device to cause a series of operational steps to be performed on the computer or other programmable device to produce a computer-implemented process such that The instructions provide steps for implementing the functions specified in the flow or blocks of the flowcharts and/or the block or blocks of the block diagrams.
在一个典型的配置中,计算设备包括一个或多个处理器(CPU)、输入/输出接口、网络接口和内存。In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
存储器可能包括计算机可读介质中的非永久性存储器,随机存取存储器(RAM)和/或非易失性内存等形式,如只读存储器(ROM)或闪存(flash RAM)。存储器是计算机可读介质的示例。Memory may include non-persistent memory in computer readable media, random access memory (RAM) and/or non-volatile memory in the form of, for example, read only memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.
计算机可读介质包括永久性和非永久性、可移动和非可移动媒体可以由任何方法或技术来实现信息存储。信息可以是计算机可读指令、数据结构、程序的模块或其他数据。计算机的存储介质的例子包括,但不限于相变内存(PRAM)、静态随机存取存储器(SRAM)、动态随机存取存储器(DRAM)、其他类型的随机存取存储器(RAM)、只读存储器(ROM)、电可擦除可编程只读存储器(EEPROM)、快闪记忆体或其他内存技术、只读光盘只读存储器(CD-ROM)、数字多功能光盘(DVD)或其他光学存储、磁盒式磁带,磁带磁磁盘存储或其他磁性存储设备或任何其他非传输介质,可用于存储可以被计算设备访问的信息。按照本文中的界定,计算机可读介质不包括暂存电脑可读媒体(transitory media),如调制的数据信号和载波。Computer-readable media includes both persistent and non-permanent, removable and non-removable media, and storage of information may be implemented by any method or technology. Information may be computer readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read only memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), Flash Memory or other memory technology, Compact Disc Read Only Memory (CD-ROM), Digital Versatile Disc (DVD) or other optical storage, Magnetic tape cartridges, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission medium that can be used to store information that can be accessed by a computing device. Computer-readable media, as defined herein, excludes transitory computer-readable media, such as modulated data signals and carrier waves.
以上仅为本申请的实施例而已,并不用于限制本申请。对于本领域技术人员来说,本申请可以有各种更改和变化。凡在本申请的精神和原理之内所作的任何修改、等同替换、改进等,均应包含在本申请的权利要求范围之内。The above are merely examples of the present application, and are not intended to limit the present application. Various modifications and variations of this application are possible for those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of this application shall be included within the scope of the claims of this application.
Claims (6)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710537712.0A CN107316296B (en) | 2017-06-29 | 2017-06-29 | A method and device for detecting changes in remote sensing images based on logarithmic transformation |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710537712.0A CN107316296B (en) | 2017-06-29 | 2017-06-29 | A method and device for detecting changes in remote sensing images based on logarithmic transformation |
Publications (2)
Publication Number | Publication Date |
---|---|
CN107316296A CN107316296A (en) | 2017-11-03 |
CN107316296B true CN107316296B (en) | 2020-11-10 |
Family
ID=60181125
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201710537712.0A Active CN107316296B (en) | 2017-06-29 | 2017-06-29 | A method and device for detecting changes in remote sensing images based on logarithmic transformation |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN107316296B (en) |
Families Citing this family (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108830828B (en) * | 2018-04-28 | 2022-02-18 | 新疆大学 | Method and device for detecting change of remote sensing image |
CN109583487A (en) * | 2018-11-21 | 2019-04-05 | 新疆大学 | A kind of SAR image change detection and device |
CN109886959B (en) * | 2019-03-19 | 2023-04-25 | 新疆大学 | Method and device for detecting image change |
CN111383216B (en) * | 2020-03-10 | 2022-04-05 | 新疆大学 | Method and device for detecting changes between images |
CN115578342A (en) * | 2022-10-08 | 2023-01-06 | 尔智机器人(珠海)有限公司 | A method for detecting changes in infrared images of substation equipment based on difference map fusion |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103456020B (en) * | 2013-09-08 | 2016-04-13 | 西安电子科技大学 | Based on the method for detecting change of remote sensing image of treelet Fusion Features |
CN103456018B (en) * | 2013-09-08 | 2017-01-18 | 西安电子科技大学 | Remote sensing image change detection method based on fusion and PCA kernel fuzzy clustering |
CN103955894B (en) * | 2014-04-14 | 2017-04-19 | 武汉科技大学 | Medical ultrasound image speckle removing method through quantum inspiration |
CN104200471B (en) * | 2014-08-30 | 2017-03-01 | 西安电子科技大学 | SAR image change detection based on adaptive weight image co-registration |
CN104778717A (en) * | 2015-05-05 | 2015-07-15 | 西安电子科技大学 | SAR image change detection method based on oriented difference chart |
CN106296655B (en) * | 2016-07-27 | 2019-05-21 | 西安电子科技大学 | SAR image change detection based on adaptive weight and high frequency threshold value |
-
2017
- 2017-06-29 CN CN201710537712.0A patent/CN107316296B/en active Active
Also Published As
Publication number | Publication date |
---|---|
CN107316296A (en) | 2017-11-03 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN107316296B (en) | A method and device for detecting changes in remote sensing images based on logarithmic transformation | |
CN112446378A (en) | Target detection method and device, storage medium and terminal | |
CN108681746A (en) | A kind of image-recognizing method, device, electronic equipment and computer-readable medium | |
CN104574126B (en) | A kind of user characteristics recognition methods and device | |
WO2023116632A1 (en) | Video instance segmentation method and apparatus based on spatio-temporal memory information | |
CN112990313A (en) | Hyperspectral image anomaly detection method and device, computer equipment and storage medium | |
CN108564083A (en) | A kind of method for detecting change of remote sensing image and device | |
CN108900622B (en) | Data fusion method and device based on Internet of things and computer readable storage medium | |
CN108830828B (en) | Method and device for detecting change of remote sensing image | |
CN105374047B (en) | SAR image change detection based on improved bilateral filtering with cluster | |
CN106295498A (en) | Remote sensing image target area detection apparatus and method | |
CN110163287A (en) | A kind of mesoscale eddy detection method and device | |
CN111259808A (en) | Detection and identification method of traffic identification based on improved SSD algorithm | |
CN109978855A (en) | A kind of method for detecting change of remote sensing image and device | |
CN107103595A (en) | Method, device, storage medium and the equipment of detection image change | |
CN115019374A (en) | Method and system for low-consumption detection of students' concentration in smart classroom based on artificial intelligence | |
CN115424142A (en) | Coastline type discrimination method, coastline type discrimination device, coastline type discrimination medium and coastline type discrimination equipment based on remote sensing images | |
CN114140628A (en) | A supervised learning algorithm image fusion method and system for parts classification | |
CN113743618A (en) | Time series data processing method and device, readable medium and electronic equipment | |
CN110852443A (en) | Feature stability detection method, device and computer readable medium | |
CN117423344A (en) | Voiceprint recognition method and device based on neural network | |
CN113034419B (en) | Method and device for objective quality evaluation of radar point cloud for machine vision tasks | |
CN114417942B (en) | A kind of clutter identification method and system and device and medium | |
CN111383216A (en) | Method and device for detecting change between images | |
Zeybek | Inlier point preservation in outlier points removed from the ALS point cloud |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |