[go: up one dir, main page]

Next Article in Journal
Spatial and Temporal Analysis of Surface Urban Heat Island and Thermal Comfort Using Landsat Satellite Images between 1989 and 2019: A Case Study in Tehran
Previous Article in Journal
Disturbance Mapping in Arctic Tundra Improved by a Planning Workflow for Drone Studies: Advancing Tools for Future Ecosystem Monitoring
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Automatic Interferogram Selection for SBAS-InSAR Based on Deep Convolutional Neural Networks

1
Institute of Space Science and Applied Technology, Harbin Institute of Technology (Shenzhen), Shenzhen 518055, China
2
School of Space Science and Physics, Shandong University, Weihai 264209, China
*
Author to whom correspondence should be addressed.
Remote Sens. 2021, 13(21), 4468; https://doi.org/10.3390/rs13214468
Submission received: 25 October 2021 / Accepted: 30 October 2021 / Published: 7 November 2021
Figure 1
<p>Structural design of the ResNet50 model.</p> ">
Figure 2
<p>Workflow of the proposed automatic interferogram selection for the SBAS-InSAR algorithm integrated with the DCNN method. (<b>I</b>) The calculation of differential interferograms of sequential deformations from SAR images. (<b>II</b>) The automatic extraction of high-quality interferograms by the ResNet50–DCNN model. (<b>III</b>) The estimation of deformation field.</p> ">
Figure 3
<p>Training sets of unwrapped interferograms with (<b>a</b>) low quality and (<b>b</b>) high quality.</p> ">
Figure 4
<p>Standard deviations of 222 simulated interferograms.</p> ">
Figure 5
<p>Histogram distribution for standard deviations of the interferogram phase based on interferograms selected by the ResNet50–DCNN method and those originally simulated.</p> ">
Figure 6
<p>The annual deformation rate based on (<b>a</b>) the spatio–temporal baseline threshold method (<b>b</b>) the manual method (<b>c</b>) the ResNet50–DCNN method. (<b>d</b>) Difference between (<b>a</b>,<b>b</b>). (<b>e</b>) Histogram of (<b>d</b>). (<b>f</b>) Differences between (<b>a</b>,<b>c</b>). (<b>g</b>) Histogram of (<b>f</b>).</p> ">
Figure 7
<p>Overview of the research area and coverage of SAR datasets.</p> ">
Figure 8
<p>Training efficiency in dependency of the number of training cycles.</p> ">
Figure 9
<p>Training efficiency in dependency of the size of the input image.</p> ">
Figure 10
<p>Interferograms selected by (<b>a</b>) the spatio-temporal baseline threshold method, (<b>b</b>) the manual method and (<b>c</b>) the ResNet50–DCNN model method.</p> ">
Figure 10 Cont.
<p>Interferograms selected by (<b>a</b>) the spatio-temporal baseline threshold method, (<b>b</b>) the manual method and (<b>c</b>) the ResNet50–DCNN model method.</p> ">
Figure 11
<p>Distribution of the standard deviations of the interferogram phase based on the three different methods displayed in form of a histogram.</p> ">
Figure 12
<p>Vertical deformation rates based on (<b>a</b>) the spatio–temporal baseline threshold method (<b>b</b>) the manual method (<b>c</b>) the ResNet50-DCNN method. (<b>d</b>) Distribution of the main subsidence areas (C1–C6) and the permanent scatter points (PS). Points A–G: Time series of specific PS points (see also <a href="#remotesensing-13-04468-f013" class="html-fig">Figure 13</a>).</p> ">
Figure 13
<p>Time series of cumulative deformations of 7 PS targets ((<b>a</b>–<b>g</b>) marked in <a href="#remotesensing-13-04468-f012" class="html-fig">Figure 12</a>d) based on the three investigated methods.</p> ">
Figure 14
<p>Annual average deformation rate of 30 randomly selected PS points obtained by the three investigated methods. See also <a href="#remotesensing-13-04468-f012" class="html-fig">Figure 12</a>d.</p> ">
Review Reports Versions Notes

Abstract

:
The small baseline subset of spaceborne interferometric synthetic aperture radar (SBAS-InSAR) technology has become a classical method for monitoring slow deformations through time series analysis with an accuracy in the centimeter or even millimeter range. Thereby, the selection of high-quality interferograms calculated is one of the key operations for the method, since it mainly determines the credibility of the deformation information. Especially in the era of big data, the demand for an automatic and effective selection method of high-quality interferograms in SBAS-InSAR technology is growing. In this paper, a deep convolutional neural network (DCNN) for automatichigh-quality interferogram selection is proposed that provides more efficient image feature extraction capabilities and a better classification performance. Therefore, the ResNet50 (a kind of DCNN) is used to identify and delete interferograms that are severely contaminated. According to simulation experiments and calculated Sentinel-1A data of Shenzhen, China, the proposed approach can significantly separate interferograms affected by turbulences in the atmosphere and by the decorrelation phase. The remarkable performance of the DCNN method is validated by the analysis of the standard deviation of interferograms and the local deformation information compared with the traditional selection method. It is concluded that DCNN algorithms can automatically select high quality interferogram for the SBAS-InSAR method and thus have a significant impact on the precision of surface deformation monitoring.

1. Introduction

The differential synthetic aperture radar interferometry (D_InSAR) technique has great potential in rapid and large-scale investigations of surface deformations [1]. However, its accuracy is, among others, often limited by long revisit cycles of satellites, low coherences irregular atmospheric turbulence, and the need of external digital elevation models (DEM). Therefore, further techniques and like the small baseline subset (SBAS) method have been developed to exploit sequences of D_InSAR interferograms for monitoring deformation time-series without being significantly affected by decorrelation noise, atmospheric influences and DEM errors affected [2,3]. It can survey the land deformation now with an accuracy in the centimeter or even millimeter range [4,5]. Recently, the InSAR techniques have developed into useful, powerful geodetic surveying tools and are widely applied to landslide monitoring [6,7], mining subsidences [8], surface deformations [9,10], volcanic activities [5], the monitoring of further geological disasters in the context of early warning issues [11,12].
Nowadays, many time series InSAR (TS-InSAR) techniques have been proposed based on the interferograms selection of SBAS strategies, including parallel SBAS (P-SBAS), multidimensional SBAS (M-SBAS) [13], New SBAS (N-SBAS) [14], and pixel-offset SBAS [15]. SAR images contain different complexities and magnitudes of noise, including those introduced by the atmosphere, the decorrelation process and other sources [16,17], which directly affect the quality of the generated interferograms. Unfortunately, these noise components cannot be precisely determined and separated from the interferograms, especially those induced by the atmosphere and decorrelation process [17,18,19]. Additionally, the process of calculating interferograms itself directly affects the accuracy of the SBAS-InSAR measurements, whereby the selection of high-quality interferogram pairs is crucial for SBAS data processing. Recently, the selection of interferometric pairs has been improved by various different algorithms. The commonly used method to obtain interferograms is setting optimal temporal and spatial baseline thresholds by exploiting the respective SAR image characteristics [15,20]. However, some low-quality interferograms with large phase errors produced by temporal and spatial variations between two single-look complex (SLC) acquisitions can be mistakenly generated this way. Triangulation reduction and a simulated annealing (SA) searching strategy can improve this constraint in processing data of C-band SAR sensors but needs a long time of operation [21]. The graph theory (GT) can be utilized to delete SAR images and interferograms disturbed by atmospheric turbulences but is not suitable for all SAR images with severe atmospheric distortions [22]. Until now, the most effective approach of high-quality interferogram selection still relies on the traditional manual method. Due to the high degree of human interaction and a large risk of repetitive work, this traditional manual method increases the instability and inconsistency of the deformation calculation.
With an ongoing development of radar satellites and the InSAR technique, the continuous calculation of interferograms becomes increasingly important and thus promotes the development of big data regarding this subject [23]. Nevertheless, the aforementioned common methods of interferogram selection for SBAS-InSAR data processing do not meet the requirements of automation and high efficiency engineering application. In this context, DCNNs, structured by a multi-layer perceptron with multiple hidden layers, have shown their dominant performance on different tasks including image interpretation and classification [24,25]. DCNNs are widely used in the field of computer science, where machines learn specific and complex information from given data by using statistical technologies [26,27,28,29,30]. In geosciences, DCNNs have achieved a superior performance on many applications, such as earthquake magnitude prediction, surface classification, vegetation science, landslide sensitivity mapping, etc. [31,32,33,34]. In the past few years, DCNN architecture has adopted transfer learning concepts such as fine tuning and layer freezing, which is superior to the traditional machine learning mode in performance and efficiency to solve the problem of image classification. Considering that the different qualities of interference pairs show different color characteristics, the DCNN method is adopted in this study. Although the training operation of a DCNN model is usually time consuming, it can be used to classify SBAS interferograms with different quality in a very short time.
The residual network is a convolutional neural network model based on residual networks, which won the victory in image classification and object recognition in the Imagenet large scale visual recognition challenge (ilsvrc) in 2015 [35]. The ResNet50 model has the advantages of representing a standard network structure and easy programming. Additionally, it can capture the color change features for the ResNet 50 without the overfitting problem compared to the ResNet10l and the ResNet152 models. Thus, it was chosen to implement the automatic classification of SAR interferograms within the SBAS-InSAR image processing model [35,36]. Section 2 describes the method of the high quality interferogram selection using the ResNet50–DCNN model and the establishment process. In Section 3 the proposed method is applied to the simulated and the actual SAR datasets and its performance is evaluated. Conclusions are presented in Section 4.

2. Materials and Methods

In this section, the differential interferogram calculation of the SBAS-InSAR technology and the ResNet50–DCNN model are introduced in detail. The higher the quality of the SBAS-InSAR interferogram, the less intense the color changes within the interferogram phase in a certain range. This can be used to separate high quality from low quality interferograms by use of the ResNet50–DCNN technique through learning the spatial behavior of color changes within the interferogram phase. The technique has the ability to classify features and learn image priors in the training phase [37,38,39,40].

2.1. Differential Interferogram Phase of the SBAS-InSAR Technology

The SBAS-InSAR technique was first proposed in 2002 by Berardino et al. [4] which made up for the shortcomings of original PS-InSAR techniques and was mainly used to monitor large-scale deformations. Differential interferograms are formed by setting appropriate parameters of spatial and temporal baselines for SAR images, which can avoid weakening of the relevant factors [3,41,42]. If there are N scene images, M interferograms are formed as follows [4]:
N + 1   2 M N   N + 1   2
A differential interferogram is created from two temporally separated SLC-SAR images and external DEM data. In SBAS-InSAR data processing, a differential interferometric phase can be described by:
Δ φ i n t = Δ φ d e f o r m + Δ φ d e m + Δ φ t r o p + Δ φ i o n o + Δ φ n o i s e
Δ φ i n t denotes the differential interferometric phase, Δ φ d e m represents the difference between the actual DEM phase and the applied DEM phase. Δ φ d e f o r m is the deformation phase, Δ φ t r o p and Δ φ i o n o represent the atmospheric phase variation between two images acquired at different times, and Δ φ n o i s e denotes the noise level (e.g., decorrelation noise phase) [41,42].
Δ φ o t h e r s = Δ φ t r o p + Δ φ i o n o + Δ φ n o i s e
Δ φ i n t = Δ φ d e f o r m + Δ φ d e m + Δ φ o t h e r s
In Equation (3), Δ φ o t h e r s represents other phases including atmospheric phase variations and noise components that need to be separated from the deformation phase during the sequential deformation processing. Thus, the differential interferometric phase is formed by the deformation phase, DEM errors phase and other phases like in Equation (4).
It is noticeable that a differential interferometric phase of high quality has a very low phase change gradient, reflected by minor color changes and a clean map. Thus, phase errors are represented by color changes within the phase map after interferogram unwrapping. Consequently, we designed a classification network using the DCNN technique based on learning the characteristics of the aforementioned phase errors.

2.2. Deep Convolution Neural Network

As one of the more famous DCNN working models with very good performance, ResNet is easy to optimize and can improve the accuracy by increasing a considerable depth. We also make experiments to divide similar images into two categories for performance evaluation of different ResNet models including ResNet50, ResNet101 and ResNet152 with the subsequent training sets. When the input size and training times are same set, the accuracy of ResNet50 model is higher than the accuracy of ResNet 101 and 152 models. It is proved that the ResNet50 is better used to capture the color change features and avoid the overfitting problem compared to the ResNet10l and the ResNet152 models. The internal residual block uses jump connection, which alleviates the problem of gradient disappearance caused by increasing the depth in neural network [43,44]. The network is composed of several residual units, which can be regarded as an extension of the two convolution layers. More sufficient feature information can be extracted by adding short connections to the convolution layer [45,46,47].
Figure 1 shows the structural design of the ResNet50–DCNN model, which is composed of an input layer, convolution layers, identical residual blocks, convolution residual blocks, pooling layers, a full connection layer and an output layer. The convolutional neural network was constructed by using the Pytorch platform, an open-source deep learning framework developed by the torch7 team of the Facebook Artificial Intelligence Research Institute. Its bottom layer is based on torch, but its implementation and application are all completed by python.
A binary classification training model and an appropriate training set have been specifically established for machine learning to automatize interferogram selection and shorten the time of data processing. The input images are sent to the convolution layer, where normalization and an activation function is accomplished. Next, an average pooling is used to reduce the number of samples, and the data is sent to the convolution residual blocks for convolution operation. Then, data are transferred to the identical residual blocks and the remaining identical residual blocks for processing. In order to reduce the amount of data to be calculated, the pooling layer is used to reduce the data dimension after the residual cell. The pooling layer results received are entered into the full connection layer, where the final output results are obtained. Table 1 shows the size of the convolution kernel and the respective output size. The experimental parameters of the real data used in this chapter are described in Section 3.2.

2.3. Automatic Interferogram Selection Using the Proposed Method

Figure 2 illustrates the detailed processing flow of the proposed automatic interferogram selection for the SBAS-InSAR algorithm integrated with the ResNet50–DCNN method. In the first step differential interferograms of sequential deformations are calculated from SAR images. Thus, foremost a precise registration between the SAR images is accomplished. After topographic phase removal, the sequential differential interferograms are generated by setting the key parameters of the time and spatial baselines based on the optimal combination conditions and data characteristics. Then differential interferograms are obtained via phase filtering, phase unwrapping and atmospheric correction.
The second part is the most crucial task of the method. The ResNet50–DCNN model is established to realize the automatic extraction of high-quality interferograms. Based on the Pytorch platform, the training model of two classifications for interferograms is constructed, comprising low-quality interferograms with significant errors and high-quality interferogram with only minor errors. Differential interferograms with less errors identified by the ResNet50–DCNN model were finally used to investigate surface deformations of the research area. The third module of the workflow is designed to identify the high coherence points, based on the singular value decomposition (SVD) calculation to estimate the linear deformation and elevation errors. Then, operations of residual phase unwrapping and temporal and spatial filtering were used to separate the nonlinear deformation from the atmospheric delay phase. The sum of the estimated linear and nonlinear deformations represents the entire deformation field. The proposed algorithm efficiently implements the automatic separation of high-quality and low-quality interferograms needed for the SBAS-InSAR method.

2.4. Establishment of Training Sets

For the data processing of the model, it is very important to establish appropriate training sets. Therefore, in this experiment, many phase unwrapping maps of interferograms of surface deformations in different regions with different land deformation characteristics were used. These procedures, including randomly selecting, cutting and filtering phase unwrapped maps, were operated to improve the computational efficiency of the network training [44,48,49,50]. More than 3000 image patches with different size and varying characteristics of color changes were generated to compose the training sets. Figure 3a,b show a section of the training set of unwrapped interferograms with low and high quality. One can see that the unwrapped interferograms with low quality (Figure 3a) are contaminated by many errors which stand out due to larger color differences through as compared to those interferograms with high quality (Figure 3b).

3. Results and Discussions

3.1. Simulation-Based Tests

A series of simulation experiments were conducted to test the performance of the proposed method for automatic selection of SBAS-InSAR interferograms based on the ResNet50–DCNN model. First, time series of linear deformations were simulated to obtain 222 interferograms. The simulated size of each image is 300 × 300 pixels and the subsidence funnel velocity is set to 25 mm per year. Then, 70 interferograms are selected at random to add various turbulent atmospheric errors and decorrelation noise [16,18,51]. Considering the time variability of the turbulent atmosphere, its simulated phase is multiplied by a random constant between 0 and 5 [18]. Here, the decorrelation noise is considered including the time decorrelation error Δ φ d e c _ t e m p , a system thermal noise decorrelation Δ φ d e c _ t h e r m a l   and the doppler centroid decorrelation Δ φ d e c _ D C , which are shown in Equation (5). For the concrete decorrelation error, a polynomial model was established for the doppler centroid decorrelation, and an exponential and a gaussian distribution model were established for a temporary correlation and the system thermal noise decorrelation.
Δ φ n o i s e = Δ φ d e c _ t e m p + Δ φ d e c _ t h e r m a l + Δ φ d e c _ D C
The temporal decorrelation results from physical changes in the terrain surface such as vegetation growth, soil moisture and other environmental factors between two SAR image acquisitions [52]. Equation (6) shows the temporal correlation ( γ t e m p ), where Δ T shows the time period according to each interferogram and β is a parameter characterizing the temporal decay of the InSAR coherence [53].
γ t e m p = exp β Δ T  
Figure 4 shows the estimation of the phase standard deviation of the simulated interferograms. It is found that the phase standard deviations of the selected interferograms with atmospheric and decorrelation noise are higher than that of the original interferograms. This indicates the phase standard deviation can reproduce or portray the interferogram quality to a certain degree [22].
Due to the phenomenon of stronger color change for low quality interferograms, the ResNet50–DCNN architecture can be constructed to eliminate these low quality interferograms. The input images of the network are unwrapped interferograms with error corrections accomplished. A multi-scale pooling layer is introduced for down-sampling the inputs of the interferogram images. The Rectified Linear Units (ReLu) activation function and the Categorical cross-entropy loss function are applied in the network learning. The back-propagation algorithm of the Adam optimization algorithm is used to initialize and train the ownership value randomly, and the Softmax function is used for classification. Then, the ResNet50 model is established for the training of the binary classification by setting the training cycles to 200, the learning rate to 0.001, and the size of the input image with three RGB channels to 128 × 128. Finally, 168 interferograms with high quality are obtained, and 54 interferograms with low quality are eliminated by the ResNet50 model. Figure 5 shows histogram distribution for standard deviations of the interferogram phase based on interferograms selected by the ResNet50–DCNN method and those originally simulated. It is found that when the interferogram phase standard deviation is lower than 2 rad, the quantity of interferograms obtained by the ResNet50–DCNN method and the simulated interferograms are substantially the same. When the standard deviation of the interferograms ranges between 2 and 10 rad, the quantity of the interferograms is quite different.
Originally, 222 interferograms have been simulated of which 152 were of high quality and 70 of low quality. By comparing the number of high-quality interferograms obtained by the ResNet50–DCNN with the original number of simulated interferograms, it turns out that the accuracy of this method is as high as 90%. Therefore, the ResNet50 model has a significant ability to automatically extract high quality interferograms for the SBAS-InSAR processing.
To obtain the annual deformation rate, stacking technology was applied. Figure 6a displays the estimated annual deformation rates of all interferograms including atmospheric decoherence and decorrelation errors simulated. Figure 6b shows a simulated annual deformation rate of 25 mm per year with no errors and Figure 6c depicts annual deformation rates of interferograms selected by the DCNN method. It is obvious that the annual deformation rate obtained by the ResNet50–DCNN method is in good agreement with the simulations shown in Figure 6b, while the annual deformation rate based on interferograms including all atmospheric and decoherence errors differs quite significantly. The deformation signal in Figure 6a is considerably distorted, and the obviously undeformed areas are contaminated by already described influencing factors. Figure 6d,f provide a somewhat more detailed view of this subject by calculating the differences between 6b and 6a and 6b and 6c, which reflects the advantages of the DCNN based method. Comparing the histograms of Figure 6d, it is noticeable that the one of Figure 6f shows a Gaussian distribution and the absolute average value is close to 1.5 mm (Figure 6g). Contrary, Figure 6d depicts a non-Gaussian distribution with a double maximum and the average absolute value is close to 4.7 mm (Figure 6e). This further implies the superiority of interferogram selection by the ResNet50–DCNN method.

3.2. Actual Subsidence Issues

The proposed interferogram selection process based on the DCNN method was finally tested in the Shenzhen area in China (Figure 7), where substantial land subsidences occur due to construction activities at unstable soils in the reclamation areas [54,55,56]. In this context, a total of 101 Sentinel-1A satellite images taken from March 2017 to December 2020 are applied. Corrections are performed by precise orbits obtained from the European Space Agency (ESA) (https://search.asf.alaska.edu, accessed on 25 October 2021). The reference DEM is obtained from the Shuttle Radar Topography Mission-3 (SRTM) at a resolution of 30 m and used to remove terrain errors in the subsequent differential interference measurements (http://gdex.cr.usgs.gov/gdex, accessed on 25 October 2021). 593 interferograms with a multi-look factor of 4 × 1 in range and azimuth directions are generated by setting the time baseline threshold and the space baseline as 75 D, and 150 m respectively. Different training cycles and input sizes of the imagery are set for the ResNet50-DCNN method in order to determine the optimal model parameters. Finally, selected interferograms of the spatio–temporal baseline threshold method and the manual method are used for validation of the proposed DCNN process.
The application of the ResNet50–DCNN model is seriously influenced by its parameters that have to be determined by analyzing different training results. The training set of two classifications with high-, and low-quality unwrapped interferograms is constructed in Section 3. In addition, the operation of Gaussian adaptive Goldstein is applied to remove noise components, and atmospheric errors are depressed by a polynomial fitting model for the differential interferograms. Finally, the ResNet50–DCNN model was used to classify differential phase unwrapped interferograms. Thereby, the standard deviations of the interferograms are used to analyze the performance of the proposed method [22]. In order to better exploit the model, two key parameters (namely the size of the input image with three RGB channels and the number of training cycles) must be chosen with great care. Table 2 shows the quality of interferograms automatically selected by the model under different parameter settings. The quality is dependent of the interferogram numbers and standard deviations of the interferogram unwrapping phase. The training learning rate was set to 0.001.
Figure 8 displays the curves of training efficiency in relation to the number of training cycles within the proposed model. The horizontal axis represents the number of training cycles of the model. The left vertical axis and the right vertical axis represent the standard deviation of the interferogram phase and the percentage of selected interferograms obtained by the model, respectively. The blue pentagram broken line shows the changes for the standard deviation of the selected interferograms phase at a varying number of training cycles. It is found that the standard deviation (SD) of the selected interferograms is the highest when the training cycles are set to 300. The red rectangle broken line shows the percentage of selected interferograms of high-quality interferograms obtained by manual method at a varying number of training cycles. The ratio increases and then decreases again with increasing training cycles. This behavior confirms that the model has the highest efficiency when the number of training cycles is set to 300.
Figure 9 displays the curve of the training efficiency as it changes with the size of the input image in the training model. The horizontal axis represents the size of the input image with three RGB channels of the Resnet50 model. The blue pentagon polyline shows the phase standard deviation of interferograms selected by the model under different input sizes. The standard deviation phase of the selected interferogram decreases continuously with the size of the input image changing from 32 × 32 to 256 × 256, and then slightly increases till an input size of 512 × 512. The red rectangle broken line also increases and then decreases again with increasing input sizes. It is found that the model has the highest efficiency when the size of the input image is set as 256 × 256. Thus, the optimum size of the input image is set to 256 × 256 and the number of training cycles is set to 300.
Figure 10a–c display the respective numbers of interferograms extracted by the three different methods. Of course, the interferograms of branch wires obtained based on ResNet50–DCNN method need to be removed. Comparing Figure 10a,b, the two methods deviate significantly, since there are 182 different interferograms and 9 different SLC images. The same is true when collating Figure 10a,c, as there are 168 different interferograms and 9 different SLC images. But there are 14 different interferograms and 0 different SLC images only by comparing Figure 10b,c. Most equal interferograms and SLC images are selected by the manual method and the ResNet50–DCNN method, which can be seen most clearly in areas marked by red dotted line ellipses. It is further indicated that the traditional spatio–temporal baseline method selects some low-quality interferograms, while the ResNet50–DCNN method removes those ones like the manual method.
Table 3 exhibits the retrievable quantity of interferograms and the absolute means and standard deviations of the interferogram unwrapping phase based on the three investigated methods. The number of interferograms obtained by the ResNet50 model nearly matches the number retrieved by the manual method but not the number obtained by the spatio–temporal baseline threshold method. By comparing the number of high-quality interferograms obtained by the ResNet50–DCNN method with the number obtained by the manual method, it turns out that the accuracy of this method is as high as 87%.
In order to confirm the performance of the proposed technique, the quality of all interferograms obtained by the three methods was analyzed and compared in detail. Figure 11 shows the distribution of the standard deviations of the differential interferogram unwrapping phase of three methods by simple histograms. When the standard deviation of the interferogram unwrapping phase is lower than 2.5 rad, the quantity of interferograms obtained by the three methods is basically the same. When the interferogram standard deviation is between 2.5 rad and 5.0 rad, the number of interferograms obtained by the spatio–temporal baseline threshold method is much higher than that of the remaining two methods, indicating that more low-quality interferograms are selected by this method. It is shown that the number of interferograms obtained by the ResNet50–DCNN model is reliable with the smallest overall error of interferograms selected and thus, also reflects the high accuracy of the proposed method depicted in Table 3.
Figure 12a–c illustrate land subsidence rates in the Shenzhen region based on interferograms selected by the three investigated methods. Figure 12d shows the locations of the 7 PS (point scatters) points (Green circle) and 30 PS points (red triangle) in the Shenzhen area. Figure 12a depicts vertical land deformation rates ranging from −40.15 mm/year to 11.15 mm/year, which are obtained from 593 interferograms based on the spatio–temporal baseline threshold method. It is found that there are different degrees of subsidences around the Baoan airport, the Qianhai Bay, at Houhai and Vanke Cloud City. There is a large-scale subsidence area along the southeast coast of the Nanshan District and a large-scale land uplift near the Lilin Park. These subsidence rates are contrary to the results derived by other scholars [54,55,57,58]. The results also reveal that interferograms obtained by the spatio–temporal baseline threshold method is strongly influenced by phase unwrapping errors induced by decorrelation noises. Figure 12b shows the vertical deformation rates obtained by the least square method and stacking technology by the manual method. The results show land subsidences ranging from −35.2 mm/year to 14.7 mm/year. The overall land subsidences are relatively stable except from some areas with different degrees of subsidence funnels. The main subsidence areas revealed, are located in the coastal areas, specifically distributed in the C1-C6 zones (Figure 12d) including Bao’an airport, Qianhai Bay, Taizi Bay, Houhai, Zhongxin Mangrove Bay and Vanke Cloud City. This deformation filed is almost the same as the results derived by other scholars [54,55,56,57,58]. Figure 12c depicts the vertical deformation rate of Shenzhen derived by the ResNet50–DCNN model. The land subsidences range from −41.2 mm/year to 15.4 mm/year, and are relatively stable overall, except for distinct places located in the C1-C6 zones. These results roughly agree with the land subsidence characteristics calculated by the manual method and the results of other studies, and confirm the considerable advantages of the ResNet50–DCNN model approach based on automatic extraction of high-quality interferograms.
For further validation of the ResNet50–DCNN model method, time series of cumulative deformations and annual deformation rates of PS were calculated and analyzed. The obtained time series of cumulative deformations of 7 PS targets based on the spatio–temporal baseline threshold method (red triangle dotted line), the detailed manual method (green triangle dotted line) and the proposed method (blue triangle dotted line) are depicted in Figure 13. Data of targets Figure 12a,c,d show a linear regression with continuing subsidence tendency, while targets Figure 12b,e–g display a kind of consolidation of the subsidence trend around the year 2018. Methodologically, it is found that the deflections of single PS measurements are smaller for the ResNet50–DCNN and the manual methods than for the spatio–temporal baseline threshold method. Apparently, the proposed ResNet50–DCNN method performs significantly better than the spatio–temporal baseline threshold method.
Figure 14 shows the annual subsidence rate of 30 evenly distributed and randomly selected permanent scatter points. It is found that the subsidence rates obtained by the manual method largely coincides with that, obtained by the ResNet50–DCNN method, while the rates derived from the spatio–temporal baseline threshold method, exhibit much stronger excursion ranges, especially when the magnitude of the respective subsidence is large.

4. Conclusions

When monitoring natural disasters such as subsidences, landslides, or mining areas, the selection of suitable uncontaminated interferograms is challenging and time consuming. For this reason, we investigated the possibility and the impact of automatic interferogram selection based on the ResNet50–DCNN model to monitor slow surface subsidences by use of the SBAS-InSAR technique. The idea is based on the fact that interferograms less contaminated by different noise sources display smaller color phase changes within a certain phase range. Hence, training sets containing almost 3000 interferograms obtained from land subsidences in several subregions of Shenzhen in China with varying contaminations of noise were established. Up next, the ResNet50–DCNN model was set up, the respective parameters were determined through analysis of the data sets trained, and traditional interferogram selection methods were used to evaluate the performance. For simulation experiments and the evaluation and validation of real data, phase unwrapping interferograms obtained by the time-spatial baseline threshold method are used to classify high and low quality interferograms based on the ResNet50 model. The quantity of high quality interferograms extracted by the ResNet50–DCNN method is above 90% for the simulation experiment and above 87% concerning the real data experiment, which reflects the accuracy and reliability of the proposed method. A comparison of the overall surface subsidence rates and the deformation information of local PS points reveals little difference between the land subsidence rates obtained by the ResNet50–DCNN method and the actual simulations or the manual method. The proposed advanced method provides an automatized and fast interferogram selection process for high quality data, which contributes significantly to the application of SBAS-InSAR engineering. For future research, we will expand the training samples and study DCNN models to further improve the general accuracy for a wider applicability of this method.

Author Contributions

All authors participated in editing and reviewing the manuscript. Y.H. implemented the methodology, constructed the model, analyzed the InSAR data, produced the results, and wrote the original paper. G.Z. constructed the model and implemented related experiment. H.K. and G.X. supervised the research and revised the manuscript. All authors have read and agreed to the published version of the manuscript.

Funding

This work is supported by the Shenzhen Science and Technology Program (Grant No. KQTD20180410161218820) and Guangdong Basic and Applied Basic Research Foundation (No: 2021A1515012600).

Institutional Review Board Statement

We choose to exclude this statement because the study did not involve humans or animals.

Informed Consent Statement

We choose to exclude this statement because the study did not involve humans.

Data Availability Statement

Authors are grateful to the European Space Agency (ESA) for providing the Sentinel-1A SAR data and the precise orbit information free of charge.

Acknowledgments

The authors like to thank the anonymous reviewers for their efforts and constructive comments to improve the quality of this paper.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Zhang, B.; Xu, G.; Lu, Z.; He, Y.; Peng, M.; Feng, X. Coseismic Deformation Mechanisms of the 2021 Ms 6.4 Yangbi Earthquake, Yunnan Province, Using InSAR Observations. Remote Sens. 2021, 13, 3961. [Google Scholar] [CrossRef]
  2. Casu, F.; Manzo, M.; Lanari, R. A quantitative assessment of the SBAS algorithm performance for surface deformation retrieval from DInSAR data. Remote Sens. Environ. 2006, 102, 195–210. [Google Scholar] [CrossRef]
  3. Hooper, A.; Bekaert, D.; Spaans, K.; Arıkan, M. Recent advances in SAR interferometry time series analysis for measuring crustal deformation. Tectonophysics 2012, 514–517, 1–13. [Google Scholar] [CrossRef]
  4. Berardino, P.; Fornaro, G.; Lanari, R.; Sansosti, E. A new algorithm for surface deformation monitoring based on small baseline differential SAR interferograms. IEEE Trans. Geosci. Remote Sens. 2002, 40, 2375–2383. [Google Scholar] [CrossRef] [Green Version]
  5. Tizzani, P.; Berardino, P.; Casu, F.; Euillades, P.; Manzo, M.; Ricciardi, G.P.; Zeni, G.; Lanari, R. Surface deformation of Long Valley caldera and Mono Basin, California, investigated with the SBAS-InSAR approach. Remote Sens. Environ. 2007, 108, 277–289. [Google Scholar] [CrossRef]
  6. Zhao, F.; Meng, X.; Zhang, Y.; Chen, G.; Su, X.; Yue, D. Landslide Susceptibility Mapping of Karakorum Highway Combined with the Application of SBAS-InSAR Technology. Sensors 2019, 19, 2685. [Google Scholar] [CrossRef] [Green Version]
  7. Teshebaeva, K.; Roessner, S.; Echtler, H.; Motagh, M.; Wetzel, H.-U.; Molodbekov, B. ALOS/PALSAR InSAR Time-Series Analysis for Detecting Very Slow-Moving Landslides in Southern Kyrgyzstan. Remote Sens. 2015, 7, 8973–8994. [Google Scholar] [CrossRef] [Green Version]
  8. Liu, D.; Shao, Y.; Liu, Z.; Riedel, B.; Sowter, A.; Niemeier, W.; Bian, Z. Evaluation of InSAR and TomoSAR for Monitoring Deformations Caused by Mining in a Mountainous Area with High Resolution Satellite-Based SAR. Remote Sens. 2014, 6, 1476–1495. [Google Scholar] [CrossRef] [Green Version]
  9. Raspini, F.; Bianchini, S.; Ciampalini, A.; Del Soldato, M.; Solari, L.; Novali, F.; Del Conte, S.; Rucci, A.; Ferretti, A.; Casagli, N. Continuous, semi-automatic monitoring of ground deformation using Sentinel-1 satellites. Sci. Rep. 2018, 8, 7253. [Google Scholar] [CrossRef] [Green Version]
  10. Hu, B.; Wang, H.S.; Sun, Y.L.; Hou, J.G.; Liang, J. Long-Term Land Subsidence Monitoring of Beijing (China) Using the Small Baseline Subset (SBAS) Technique. Remote Sens. 2014, 6, 3648–3661. [Google Scholar] [CrossRef] [Green Version]
  11. Casu, F.; Lanari, R.; Sansosti, E.; Poland, M.; Miklius, A.; Solaro, G.; Tizzani, P. SBAS-InSAR analysis of surface deformation at Mauna Loa and Kilauea volcanoes in Hawaii. In Proceedings of the 2009 IEEE International Geoscience and Remote Sensing Symposium, Cape Town, South Africa, 12–17 July 2009; pp. IV-41–IV-44. [Google Scholar]
  12. Mouginot, J.; Scheuchl, B.; Rignot, E. Mapping of Ice Motion in Antarctica Using Synthetic-Aperture Radar Data. Remote Sens. 2012, 4, 2753–2767. [Google Scholar] [CrossRef] [Green Version]
  13. Zhang, L.; Lu, Z.; Ding, X.; Jung, H.-S.; Feng, G.; Lee, C.-W. Mapping ground surface deformation using temporarily coherent point SAR interferometry: Application to Los Angeles Basin. Remote Sens. Environ. 2012, 117, 429–439. [Google Scholar] [CrossRef]
  14. Zhang, Y.; Zhang, J.; Gong, W.; Lu, Z. Monitoring urban subsidence based on SAR lnterferometric point target analysis. Acta Geod. Cartogr. Sin. 2009, 38, 482–487. [Google Scholar]
  15. Casu, F.; Manconi, A.; Pepe, A.; Lanari, R. Deformation Time-Series Generation in Areas Characterized by Large Displacement Dynamics: The SAR Amplitude Pixel-Offset SBAS Technique. IEEE Trans. Geosci. Remote Sens. 2011, 49, 2752–2763. [Google Scholar] [CrossRef]
  16. Esfahany, S.S. Exploitation of Distributed Scatterers in Synthetic Aperture Radar Interferometry. Ph.D. Thesis, Delft University of Technology, Delft, The Netherlands, March 2017. [Google Scholar]
  17. Agram, P.S.; Simons, M. A noise model for InSAR time series. J. Geophys. Res. Solid Earth JGR 2015, 120, 2752–2771. [Google Scholar] [CrossRef]
  18. Cao, Y.; Li, Z.; Wei, J.; Hu, J.; Duan, M.; Feng, G. Stochastic modeling for time series InSAR: With emphasis on atmospheric effects. J. Geod. 2018, 92, 185–204. [Google Scholar] [CrossRef]
  19. Jiang, M.; Guarnieri, A.M. Distributed Scatterer Interferometry With the Refinement of Spatiotemporal Coherence. IEEE Trans. Geosci. Remote Sens. 2020, 58, 3977–3987. [Google Scholar] [CrossRef]
  20. Wang, Z.; Zhang, J.; Yu, Y.; Liu, J.; Liu, W.; Jiang, N.; Guo, D. Monitoring, Analyzing, and Modeling for Single Subsidence Basin in Coal Mining Areas Based on SAR Interferometry with L-Band Data. Sci. Program. 2021, 2021, 6662097. [Google Scholar] [CrossRef]
  21. Pepe, A.; Yang, Y.; Manzo, M.; Lanari, R. Improved EMCF-SBAS Processing Chain Based on Advanced Techniques for the Noise-Filtering and Selection of Small Baseline Multi-Look DInSAR Interferograms. IEEE Trans. Geosci. Remote Sens. 2015, 53, 4394–4417. [Google Scholar] [CrossRef]
  22. Duan, M.; Xu, B.; Li, Z.; Wu, W.; Wei, J.; Cao, Y.; Liu, J. Adaptively Selecting Interferograms for SBAS-InSAR Based on Graph Theory and Turbulence Atmosphere. IEEE Access 2020, 8, 112898–112909. [Google Scholar] [CrossRef]
  23. Casu, F.; Manunta, M.; Agram, P.S.; Crippen, R.E. Big Remotely Sensed Data: Tools, applications and experiences. Remote Sens. Environ. 2017, 202, 1–2. [Google Scholar] [CrossRef]
  24. Krizhevsky, A.; Sutskever, I.; Hinton, G.E. ImageNet classification with deep convolutional neural networks. Commun. ACM 2017, 60, 84–90. [Google Scholar] [CrossRef]
  25. Smirnov, E.A.; Timoshenko, D.M.; Andrianov, S.N. Comparison of Regularization Methods for ImageNet Classification with Deep Convolutional Neural Networks. AASRI Procedia 2014, 6, 89–94. [Google Scholar] [CrossRef]
  26. Mukherjee, S.; Zimmer, A.; Sun, X.; Ghuman, P.; Cheng, I. An Unsupervised Generative Neural Approach for InSAR Phase Filtering and Coherence Estimation. IEEE Geosci. Remote Sens. Lett. 2020, 18, 1971–1975. [Google Scholar] [CrossRef]
  27. Ouahabi, A.; Taleb-Ahmed, A. Deep learning for real-time semantic segmentation: Application in ultrasound imaging. Pattern Recognit. Lett. 2021, 144, 27–34. [Google Scholar] [CrossRef]
  28. Khaldi, Y.; Benzaoui, A.; Ouahabi, A.; Jacques, S.; Taleb-Ahmed, A. Ear Recognition Based on Deep Unsupervised Active Learning. IEEE Sens. J. 2021, 21, 20704–20713. [Google Scholar] [CrossRef]
  29. Adjabi, I.; Ouahabi, A.; Benzaoui, A.; Jacques, S. Multi-Block Color-Binarized Statistical Images for Single-Sample Face Recognition. Sensors 2021, 21, 728. [Google Scholar] [CrossRef]
  30. Adjabi, I.; Ouahabi, A.; Benzaoui, A.; Taleb-Ahmed, A. Past, Present, and Future of Face Recognition: A Review. Electronics 2020, 9, 1188. [Google Scholar] [CrossRef]
  31. Anantrasirichai, N.; Biggs, J.; Kelevitz, K.; Sadeghi, Z.; Bull, D. Deep Learning Framework for Detecting Ground Deformation in the Built Environment using Satellite InSAR data. IEEE Trans. Geosci. Remote Sens. 2020, 59, 2940–2950. [Google Scholar] [CrossRef]
  32. Abrams, J.F.; Vashishtha, A.; Wong, S.T.; Nguyen, A.; Mohamed, A.; Wieser, S.; Kuijper, A.; Wilting, A.; Mukhopadhyay, A. Habitat-Net: Segmentation of habitat images using deep learning. Ecol. Inform. 2019, 51, 121–128. [Google Scholar] [CrossRef]
  33. Sun, J.; Wauthier, C.; Stephens, K.; Gervais, M.; Cervone, G.; La Femina, P.; Higgins, M. Automatic Detection of Volcanic Surface Deformation Using Deep Learning. J. Geophys. Res. Solid Earth 2020, 125, e2020JB019840. [Google Scholar] [CrossRef]
  34. Yilmaz, I. Landslide susceptibility mapping using frequency ratio, logistic regression, artificial neural networks and their comparison: A case study from Kat landslides (Tokat—Turkey). Comput. Geosci. 2009, 35, 1125–1138. [Google Scholar] [CrossRef]
  35. He, K.; Zhang, X.; Ren, S.; Sun, J. Identity Mappings in Deep Residual Networks. In Proceedings of the Computer Vision—ECCV 2016, Amsterdam, The Netherlands, 11–14 October 2016; pp. 630–645. [Google Scholar]
  36. Szegedy, C.; Ioffe, S.; Vanhoucke, V.; Alemi, A. Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning. Available online: https://arxiv.org/abs/1602.07261 (accessed on 25 October 2021).
  37. Graupe, D. Deep Learning Neural Networks; Elsevier Science Ltd.: Amsterdam, The Netherlands, 2015; Volume 61, pp. 85–117. [Google Scholar] [CrossRef] [Green Version]
  38. Chen, Y.; Lin, Z.; Zhao, X.; Wang, G.; Gu, Y. Deep Learning-Based Classification of Hyperspectral Data. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2014, 7, 2094–2107. [Google Scholar] [CrossRef]
  39. Hamiane, M.; Jacques, S.; Ouahabi, A.; Arbaoui, A. Wavelet-based multiresolution analysis coupled with deep learning to efficiently monitor cracks in concrete. Frat. Integrità Strutt. 2021, 15, 33–47. [Google Scholar] [CrossRef]
  40. Arbaoui, A.; Ouahabi, A.; Jacques, S.; Hamiane, M. Concrete Cracks Detection and Monitoring Using Deep Learning-Based Multiresolution Analysis. Electronics 2021, 10, 1772. [Google Scholar] [CrossRef]
  41. Guzzetti, F.; Manunta, M.; Ardizzone, F.; Pepe, A.; Cardinali, M.; Zeni, G.; Reichenbach, P.; Lanari, R. Analysis of Ground Deformation Detected Using the SBAS-DInSAR Technique in Umbria, Central Italy. Pure Appl. Geophys. 2009, 166, 1425–1459. [Google Scholar] [CrossRef]
  42. Gee, D.; Bateson, L.; Sowter, A.; Grebby, S.; Novellino, A.; Cigna, F.; Marsh, S.; Banton, C.; Wyatt, L. Ground Motion in Areas of Abandoned Mining: Application of the Intermittent SBAS (ISBAS) to the Northumberland and Durham Coalfield, UK. Geosciences 2017, 7, 85. [Google Scholar] [CrossRef] [Green Version]
  43. Goyal, P.; Dollár, P.; Girshick, R.; Noordhuis, P.; Wesolowski, L.; Kyrola, A.; Tulloch, A.; Jia, Y.; He, K. Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour. arXiv 2017, arXiv:1706.02677. [Google Scholar]
  44. Cao, Q.; Shen, L.; Xie, W.; Parkhi, O.M.; Zisserman, A. VGGFace2: A Dataset for Recognising Faces across Pose and Age. In Proceedings of the 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018), Xi’an, China, 15–19 May 2018; pp. 67–74. [Google Scholar]
  45. Tzirakis, P.; Trigeorgis, G.; Nicolaou, M.A.; Schuller, B.W.; Zafeiriou, S. End-to-End Multimodal Emotion Recognition Using Deep Neural Networks. IEEE J. Sel. Top. Signal Process. 2017, 11, 1301–1309. [Google Scholar] [CrossRef] [Green Version]
  46. Bruzzone, L.; Prieto, D.F.; Serpico, S.B. A neural-statistical approach to multitemporal and multisource remote-sensing image classification. IEEE Trans. Geosci. Remote Sens. 1999, 37, 1350–1359. [Google Scholar] [CrossRef] [Green Version]
  47. Kuncheva, L.I. Combining Classiers: Soft Computing Solutions; World Scientific: Singapore, 2001. [Google Scholar]
  48. Labat, V.; Remenieras, J.P.; Bou Matar, O.; Ouahabi, A.; Patat, F. Harmonic propagation of finite amplitude sound beams: Experimental determination of the nonlinearity parameter B/A. Ultrasonics 2000, 38, 292–296. [Google Scholar] [CrossRef]
  49. Ouahabi, A. A review of wavelet denoising in medical imaging. In Proceedings of the 2013 8th International Workshop on Systems, Signal Processing and Their Applications (WoSSPA), Algiers, Algeria, 12–15 May 2013; pp. 19–26. [Google Scholar]
  50. Ahmed, S.S.; Messali, Z.; Ouahabi, A.; Trepout, S.; Messaoudi, C.; Marco, S. Nonparametric Denoising Methods Based on Contourlet Transform with Sharp Frequency Localization: Application to Low Exposure Time Electron Microscopy Images. Entropy 2015, 17, 3461–3478. [Google Scholar] [CrossRef] [Green Version]
  51. Hanssen, R.F. Radar Interferometry Data Interpretation and Error Analysis; Springer Science & Business Media: Berlin/Heidelberg, Germany, 2001. [Google Scholar]
  52. Santoro, M.; Wegmuller, U.; Askne, J.I.H. Signatures of ERS–Envisat Interferometric SAR Coherence and Phase of Short Vegetation: An Analysis in the Case of Maize Fields. IEEE Trans. Geosci. Remote Sens. 2010, 48, 1702–1713. [Google Scholar] [CrossRef]
  53. Lee, C.-W.; Lu, Z.; Jung, H.-S. Simulation of time-series surface deformation to validate a multi-interferogram InSAR processing technique. Int. J. Remote Sens. 2012, 33, 7075–7087. [Google Scholar] [CrossRef]
  54. Xu, B.; Feng, G.; Li, Z.; Wang, Q.; Wang, C.; Xie, R. Coastal Subsidence Monitoring Associated with Land Reclamation Using the Point Target Based SBAS-InSAR Method: A Case Study of Shenzhen, China. Remote Sens. 2016, 8, 652. [Google Scholar] [CrossRef] [Green Version]
  55. Liu, P.; Chen, X.; Li, Z.; Zhang, Z.; Xu, J.; Feng, W.; Wang, C.; Hu, Z.; Tu, W.; Li, H. Resolving Surface Displacements in Shenzhen of China from Time Series InSAR. Remote Sens. 2018, 10, 1162. [Google Scholar] [CrossRef] [Green Version]
  56. He, Y.; Xu, G.; Kaufmann, H.; Wang, J.; Ma, H.; Liu, T. Integration of InSAR and LiDAR Technologies for a Detailed Urban Subsidence and Hazard Assessment in Shenzhen, China. Remote Sens. 2021, 13, 2366. [Google Scholar] [CrossRef]
  57. Zhao, Q.; Lin, H.; Chen, F.; Gao, W. InSAR detection of residual settlement of ocean reclamation areas in Shenzhen, China. In Proceedings of the 2011 19th International Conference on Geoinformatics, Shanghai, China, 24–26 June 2011; pp. 1–5. [Google Scholar]
  58. Lu, D.; Toro, F.G.; Cai, B. Methods for certification of GNSS-based safe vehicle localisation i. In Proceedings of the IEEE 2015 International Conference on Connected Vehicles and Expo (ICCVE), Shenzhen, China, 19–23 October 2015; pp. 226–231. [Google Scholar]
Figure 1. Structural design of the ResNet50 model.
Figure 1. Structural design of the ResNet50 model.
Remotesensing 13 04468 g001
Figure 2. Workflow of the proposed automatic interferogram selection for the SBAS-InSAR algorithm integrated with the DCNN method. (I) The calculation of differential interferograms of sequential deformations from SAR images. (II) The automatic extraction of high-quality interferograms by the ResNet50–DCNN model. (III) The estimation of deformation field.
Figure 2. Workflow of the proposed automatic interferogram selection for the SBAS-InSAR algorithm integrated with the DCNN method. (I) The calculation of differential interferograms of sequential deformations from SAR images. (II) The automatic extraction of high-quality interferograms by the ResNet50–DCNN model. (III) The estimation of deformation field.
Remotesensing 13 04468 g002
Figure 3. Training sets of unwrapped interferograms with (a) low quality and (b) high quality.
Figure 3. Training sets of unwrapped interferograms with (a) low quality and (b) high quality.
Remotesensing 13 04468 g003
Figure 4. Standard deviations of 222 simulated interferograms.
Figure 4. Standard deviations of 222 simulated interferograms.
Remotesensing 13 04468 g004
Figure 5. Histogram distribution for standard deviations of the interferogram phase based on interferograms selected by the ResNet50–DCNN method and those originally simulated.
Figure 5. Histogram distribution for standard deviations of the interferogram phase based on interferograms selected by the ResNet50–DCNN method and those originally simulated.
Remotesensing 13 04468 g005
Figure 6. The annual deformation rate based on (a) the spatio–temporal baseline threshold method (b) the manual method (c) the ResNet50–DCNN method. (d) Difference between (a,b). (e) Histogram of (d). (f) Differences between (a,c). (g) Histogram of (f).
Figure 6. The annual deformation rate based on (a) the spatio–temporal baseline threshold method (b) the manual method (c) the ResNet50–DCNN method. (d) Difference between (a,b). (e) Histogram of (d). (f) Differences between (a,c). (g) Histogram of (f).
Remotesensing 13 04468 g006
Figure 7. Overview of the research area and coverage of SAR datasets.
Figure 7. Overview of the research area and coverage of SAR datasets.
Remotesensing 13 04468 g007
Figure 8. Training efficiency in dependency of the number of training cycles.
Figure 8. Training efficiency in dependency of the number of training cycles.
Remotesensing 13 04468 g008
Figure 9. Training efficiency in dependency of the size of the input image.
Figure 9. Training efficiency in dependency of the size of the input image.
Remotesensing 13 04468 g009
Figure 10. Interferograms selected by (a) the spatio-temporal baseline threshold method, (b) the manual method and (c) the ResNet50–DCNN model method.
Figure 10. Interferograms selected by (a) the spatio-temporal baseline threshold method, (b) the manual method and (c) the ResNet50–DCNN model method.
Remotesensing 13 04468 g010aRemotesensing 13 04468 g010b
Figure 11. Distribution of the standard deviations of the interferogram phase based on the three different methods displayed in form of a histogram.
Figure 11. Distribution of the standard deviations of the interferogram phase based on the three different methods displayed in form of a histogram.
Remotesensing 13 04468 g011
Figure 12. Vertical deformation rates based on (a) the spatio–temporal baseline threshold method (b) the manual method (c) the ResNet50-DCNN method. (d) Distribution of the main subsidence areas (C1–C6) and the permanent scatter points (PS). Points A–G: Time series of specific PS points (see also Figure 13).
Figure 12. Vertical deformation rates based on (a) the spatio–temporal baseline threshold method (b) the manual method (c) the ResNet50-DCNN method. (d) Distribution of the main subsidence areas (C1–C6) and the permanent scatter points (PS). Points A–G: Time series of specific PS points (see also Figure 13).
Remotesensing 13 04468 g012
Figure 13. Time series of cumulative deformations of 7 PS targets ((ag) marked in Figure 12d) based on the three investigated methods.
Figure 13. Time series of cumulative deformations of 7 PS targets ((ag) marked in Figure 12d) based on the three investigated methods.
Remotesensing 13 04468 g013
Figure 14. Annual average deformation rate of 30 randomly selected PS points obtained by the three investigated methods. See also Figure 12d.
Figure 14. Annual average deformation rate of 30 randomly selected PS points obtained by the three investigated methods. See also Figure 12d.
Remotesensing 13 04468 g014
Table 1. Convolution kernel sizes and output sizes of the ResNet50 model.
Table 1. Convolution kernel sizes and output sizes of the ResNet50 model.
Layer NameOutput SizeConfiguration
CONV_11/27 × 7, 64, stride = 2
CONV_21/4 1 × 1 , 64 3 × 3 , 64 1 × 1 , 256 × 3
CONV_31/8 1 × 1 , 128 3 × 3 , 128 1 × 1 , 512 × 4
CONV_41/16 1 × 1 , 256 3 × 3 , 256 1 × 1 , 1024 × 6
CONV_51/32 1 × 1 , 512 3 × 3 , 512 1 × 1 , 2048 × 3
Classifier1 × 1Average pooling,
Fc (Full connection), 1000, Softmax
Table 2. Setting of training parameters and results of the Resnet50 model.
Table 2. Setting of training parameters and results of the Resnet50 model.
Size of Input ImageTraining CyclesInterferogram NumberStandard Deviation of Interferogram Phase/RadAccuracy (%)
128 × 1281004321.69974.4
128 × 1282004471.682986.34
128 × 1283004251.640688.53
128 × 1284004611.730281.28
128 × 1285004311.700580.10
128 × 1286004411.674986.00
128 × 1287004641.711887.18
128 × 1288004561.698285.50
32 × 323004371.753771.0
64 × 643004481.715375.71
128 × 1283004251.640688.53
256 × 2563004141.622589.00
512 × 5123004111.658581.62
Table 3. Derived number and standard deviations of the interferogram phase obtained by the three methods.
Table 3. Derived number and standard deviations of the interferogram phase obtained by the three methods.
The Spatio–Temporal Baseline Threshold MethodThe Manual MethodThe ResNet50–DCNN Method
Number of interferogram593411425
Standard deviation of interferogram phase/rad2.10541.63281.6406
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

He, Y.; Zhang, G.; Kaufmann, H.; Xu, G. Automatic Interferogram Selection for SBAS-InSAR Based on Deep Convolutional Neural Networks. Remote Sens. 2021, 13, 4468. https://doi.org/10.3390/rs13214468

AMA Style

He Y, Zhang G, Kaufmann H, Xu G. Automatic Interferogram Selection for SBAS-InSAR Based on Deep Convolutional Neural Networks. Remote Sensing. 2021; 13(21):4468. https://doi.org/10.3390/rs13214468

Chicago/Turabian Style

He, Yufang, Guangzong Zhang, Hermann Kaufmann, and Guochang Xu. 2021. "Automatic Interferogram Selection for SBAS-InSAR Based on Deep Convolutional Neural Networks" Remote Sensing 13, no. 21: 4468. https://doi.org/10.3390/rs13214468

APA Style

He, Y., Zhang, G., Kaufmann, H., & Xu, G. (2021). Automatic Interferogram Selection for SBAS-InSAR Based on Deep Convolutional Neural Networks. Remote Sensing, 13(21), 4468. https://doi.org/10.3390/rs13214468

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop