[go: up one dir, main page]

CN112285793B - A kind of magnetotelluric denoising method and system - Google Patents

A kind of magnetotelluric denoising method and system Download PDF

Info

Publication number
CN112285793B
CN112285793B CN202011309115.0A CN202011309115A CN112285793B CN 112285793 B CN112285793 B CN 112285793B CN 202011309115 A CN202011309115 A CN 202011309115A CN 112285793 B CN112285793 B CN 112285793B
Authority
CN
China
Prior art keywords
data segment
matrix
denoised
sounding
magnetotelluric
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN202011309115.0A
Other languages
Chinese (zh)
Other versions
CN112285793A (en
Inventor
韩江涛
周瑞
刘立家
郭振宇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jilin University
Original Assignee
Jilin University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jilin University filed Critical Jilin University
Priority to CN202011309115.0A priority Critical patent/CN112285793B/en
Publication of CN112285793A publication Critical patent/CN112285793A/en
Application granted granted Critical
Publication of CN112285793B publication Critical patent/CN112285793B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01VGEOPHYSICS; GRAVITATIONAL MEASUREMENTS; DETECTING MASSES OR OBJECTS; TAGS
    • G01V3/00Electric or magnetic prospecting or detecting; Measuring magnetic field characteristics of the earth, e.g. declination, deviation
    • G01V3/38Processing data, e.g. for analysis, for interpretation, for correction

Landscapes

  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Environmental & Geological Engineering (AREA)
  • Geology (AREA)
  • Remote Sensing (AREA)
  • Physics & Mathematics (AREA)
  • General Life Sciences & Earth Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Geophysics (AREA)
  • Measurement And Recording Of Electrical Phenomena And Electrical Characteristics Of The Living Body (AREA)

Abstract

本发明涉及一种大地电磁去噪方法及系统,对大地电磁脉动信号进行重叠分段,确定每个测深数据段的近似熵,将近似熵大于近似熵阈值的测深数据段确定为有效测深数据段,将其他测深数据段确定为待去噪测深数据段,选用近似熵对数据段进行筛选,防止了对有效测深数据段的“过处理”;对待去噪测深数据段进行奇异值分解,将分解后的奇异值矩阵、左和右奇异矩阵相乘,获得多个分量矩阵,构造相应的分量数据段,确定每个分量数据段的近似熵,将筛选的近似熵大于测深数据段的近似熵的分量数据段求和,获得去噪后的测深数据段,实现了去噪的目的;最后将去噪后的测深数据段和有效测深数据段重构,获得重构去噪大地电磁脉动信号,提高了数据去噪的准确性。

Figure 202011309115

The invention relates to a magnetotelluric denoising method and system. The magnetotelluric pulsation signal is overlapped and segmented, the approximate entropy of each sounding data segment is determined, and the sounding data segment whose approximate entropy is greater than the approximate entropy threshold is determined as an effective sounding data segment. For the depth data segment, other sounding data segments are determined as the sounding data segments to be denoised, and approximate entropy is used to filter the data segments, which prevents the "overprocessing" of the effective sounding data segments; Perform singular value decomposition, multiply the decomposed singular value matrix, left and right singular matrix, obtain multiple component matrices, construct corresponding component data segments, determine the approximate entropy of each component data segment, and filter the approximate entropy greater than The approximate entropy component data segments of the sounding data segment are summed to obtain the denoised sounding data segment, which realizes the purpose of denoising. It can denoise the magnetotelluric pulsation signal and improve the accuracy of data denoising.

Figure 202011309115

Description

Magnetotelluric denoising method and system
Technical Field
The invention relates to the field of data processing, in particular to a magnetotelluric denoising method and a magnetotelluric denoising system.
Background
A Magnetotelluric sounding Method (MT) observes a component disturbance value generated by a natural electromagnetic field signal through an underground medium on the ground surface so as to acquire an electrical structure of the underground medium. The field source is a natural electromagnetic field, effective signals originate from interaction of lightning discharge and solar wind with an earth magnetic layer, and compared with an electromagnetic sounding method of an artificial field source, the MT has the advantages of rich frequency band information, large detection depth and the like, so that the MT is widely applied to a plurality of fields of oil and gas field general survey exploration, earthquake prediction, mine exploration and the like. However, the natural electromagnetic field signal is weak, and is easily interfered by various electromagnetic noises during the measurement, especially in the strong interference environment such as a mining area. The effective signal has the obvious inconsistent property with noise interference, the effective signal has the characteristics of randomness, non-stationarity, non-Gaussian and the like, the interference signal usually has a certain polarization direction and strong signal energy, and when the strong interference source is close to the measuring point, the interference signal can completely cover the effective signal. Thus, the data quality is very poor, and serious deviation occurs in estimating the impedance, thereby causing a near source interference phenomenon. Therefore, achieving effective suppression of noise is a prerequisite for the MT method to be able to obtain an accurate electrical structure.
The existing methods for removing magnetotelluric noise can be mainly classified into the following three categories: the time domain processing method comprises the following steps: the method mainly identifies and removes noise forms obviously existing in a time sequence, and typically represents a method such as a form filtering method, a subspace enhancement algorithm, matching pursuit, compressed sensing and the like. For example, a morphological filtering method using rectangular structural elements only has the best processing effect on square waves, but cannot effectively remove large-scale noise and abrupt noise in other forms such as charge-discharge triangular waves. Therefore, at present, a plurality of time domain methods are often combined to perform denoising processing, but the corresponding processing time is increased; the time-frequency conversion method comprises the following steps: the time series is converted into other domains (such as frequency domain, wavelet domain, etc.), noise is removed by screening the spectral information of the signal, which typically represents methods such as wavelet analysis, Empirical mode decomposition (Empirical mode decomposition), and Variational mode decomposition (Variational mode decomposition), but has the problems of mother wavelet function and decomposition layer number selection, modal aliasing, preset parameter selection, etc. Thirdly, the frequency domain processing method comprises the following steps: the method comprises a least square method, Robust estimation, a far reference method and the like, and is mainly associated with impedance estimation, for example, the far reference method replaces self-power spectrum data of a measuring point by cross-power spectrum data between the reference point and the measuring point to perform impedance calculation, and can remove noise irrelevant to the reference point in the measuring point data. Therefore, when the signal-to-noise ratio of the acquired data is high or the form of the existing noise is regular, the existing magnetotelluric denoising technology can achieve a good processing effect, but in actual observation, the noise form is often complex and changeable, and particularly in a mine collection area, the requirement of high signal-to-noise ratio is difficult to meet.
Based on the difference between the properties of the magnetotelluric effective signal and the interfering signal, it is proposed to remove the noise by using SVD (Singular Value Decomposition). Before SVD, a one-dimensional time sequence vector needs to be converted into a multi-dimensional matrix, the SVD extracts different singular values (arranged from large to small and can be understood as field source values to a certain extent) through the overall characteristics of the multi-dimensional matrix and the local characteristics of each row of vectors, calculates each decomposition component of the time sequence vector through the singular values, each component is an electromagnetic wave signal excited by different field sources, and achieves the purpose of denoising by judging whether the component is an effective signal or not. Therefore, the method is mainly related to the number of decomposed components when removing the noise (when the number of the components is large, the more detailed signal decomposition is, the effective signal and the noise can be completely separated, but the processing time is correspondingly increased; when the number of the components is small, the processing speed is high, but the effective signal can be lost), has no requirement on the signal-to-noise ratio, and can be applied to data denoising processing of a mining area. And the method does not carry out denoising processing according to the noise form, but identifies and removes the interference (singular value) field source. The electromagnetic wave form excited by the interference source is complex and changeable, so that the method can simultaneously process various types of noise and is not limited by the noise form. However, when the data segment is a pure signal, the denoising processing of the screening component is still performed, and the problem of "over processing" of the effective signal occurs.
Disclosure of Invention
The invention aims to provide a magnetotelluric denoising method and a magnetotelluric denoising system, which are used for reducing the over-processing of data and improving the data denoising accuracy.
In order to achieve the purpose, the invention provides the following scheme:
a magnetotelluric denoising method, the method comprising:
measuring magnetotelluric pulse signals of different depths of the earth by using a magnetotelluric sounding method;
carrying out overlapping segmentation on the magnetotelluric pulse signals to obtain a plurality of sounding data segments;
determining the approximate entropy of each sounding data segment based on the approximate entropy theory;
determining the depth measuring data segment with the approximate entropy smaller than or equal to the approximate entropy threshold value as a depth measuring data segment to be denoised, and determining the depth measuring data segment with the approximate entropy larger than the approximate entropy threshold value as an effective depth measuring data segment;
constructing a matrix to be denoised according to the sounding data segment to be denoised;
performing singular value decomposition on the matrix to be denoised to obtain a singular value matrix, a left singular matrix and a right singular matrix of the matrix to be denoised;
multiplying each diagonal element of the singular value matrix, the column vector corresponding to the left singular matrix and the row vector corresponding to the right singular matrix to obtain a plurality of field source component matrixes of the sounding data segment to be denoised;
converting each field source component matrix into a component data segment;
determining the approximate entropy of each component data segment based on the approximate entropy theory;
screening the component data sections with the approximate entropy larger than that of the depth measuring data section to be denoised, and summing the screened component data sections to obtain the denoised depth measuring data section;
and reconstructing the denoised sounding data segment and the effective sounding data segment to obtain a reconstructed denoised magnetotelluric pulse signal.
Optionally, the performing overlapping segmentation on the magnetotelluric pulse signal to obtain a plurality of sounding data segments specifically includes:
for the magnetotelluric pulse signal x1,x2,…xwPerforming overlapping segmentation processing to obtain each depth measurement data segment Xv={x(v-1)*N+1,x(v-1)*N+2,…,x(v-1)*N+N};
Wherein x is1,x2,…xwRespectively the 1 st, 2 nd and w th magnetotelluric pulse signals, w is the length of the magnetotelluric pulse signal, x(v-1)*N+1、x(v-1)*N+2、x(v-1)*N+NThe data are respectively the 1 st, 2 nd and nth data of the v-th sounding data segment, N is the sounding data segment length, v is 1,2, …, l is the number of sounding data segments, l is (w- α N)/N (1- α), and α is the data overlap ratio.
Optionally, the determining the approximate entropy of each depth measurement data segment based on the approximate entropy theory specifically includes:
initializing the embedding dimension of the Henkel matrix as h;
constructing a Hankel matrix of the embedding dimension for each sounding data segment; each column in the hankel matrix is a mode vector;
using formulas
Figure GDA0003098572710000041
Determining the maximum distance between the p mode vector in the Henkel matrix and the q mode vector of the Henkel matrix;
counting the number of the p-th mode vector in the Hankel matrix, wherein the maximum distance between the p-th mode vector and all the mode vectors of the Hankel matrix is smaller than or equal to a mode fault tolerance threshold;
based on the approximate probability theory, according to the number, using formula Cp h(r)=Np h(r)/(N-h +1), determining an approximate probability value of the p-th mode vector in the hankel matrix;
using a formula based on the approximate probability value
Figure GDA0003098572710000042
Determining an approximate probability average value of each sounding data segment under the h embedding dimension;
increasing the embedding dimension h by 1, returning to the step of constructing a Hankel matrix with the embedding dimension h for each depth measuring data segment, and determining the approximate probability average value of each depth measuring data segment under the embedding dimension h + 1;
according to the approximate probability average value of each sounding data segment in the h embedding dimension and the approximate probability average value of each sounding data segment in the h +1 embedding dimension, a formula is utilized
Figure GDA0003098572710000043
Determining an approximate entropy of each sounding data segment;
wherein d ismax[y(p),y(q)]Is the maximum distance between the p-th mode vector in the Hankel matrix and the q-th mode vector in the Hankel matrix, y (p) is the p-th mode vector in the Hankel matrix, y (q) is the q-th mode vector in the Hankel matrix, and x (p + delta) is the Hankel matrixThe delta-th element of the p-th mode vector in the matrix, x (q + delta) is the delta-th element of the q-th mode vector in the hank matrix, delta is 1,2, …, h, Cp h(r) is the approximate probability value of the p-th pattern vector in the Hankel matrix, Np h(r) is the number of maximum distances less than or equal to the mode fault tolerance threshold, r is the mode fault tolerance threshold, N is the sounding data segment length,
Figure GDA0003098572710000044
is an approximate probability average of the sounding data segment in the h embedding dimension,
Figure GDA0003098572710000045
is the approximate probability average, Ae, of the sounding data segment in the h +1 embedding dimensioniIs the approximate entropy of the ith sounding data segment.
Optionally, constructing a matrix to be denoised according to the sounding data segment to be denoised specifically includes:
according to the preset matrix dimension, the a-th sounding data segment X to be denoiseda={x(a-1)*N+1,x(a-1)*N+2,…,x(a-1)*N+NEqually dividing into a plurality of sections;
constructing a matrix to be denoised according to each section after the equal division
Figure GDA0003098572710000051
Wherein, XaFor the a-th sounding data segment to be denoised, x(a-1)*N+1、x(a-1)*N+2、x(a-1)*N+n、x(a-1)*N+1+n、x(a-1)*N+2n、xa*N+1-nAnd x(a-1)*N+NRespectively representing the 1 st, 2 nd, nth, N +1 st, 2 nth, N-N +1 th and nth data of the depth measuring data segment to be denoised, wherein N is the length of the depth measuring data segment, N is the length of a preset matrix, N is N/m, and m is the dimension of the preset matrix.
Optionally, the performing singular value decomposition on the matrix to be denoised to obtain a singular value matrix, a left singular matrix, and a right singular matrix of the matrix to be denoised, and then further includes:
determining the ratio of each singular value in the singular value matrix to the sum of all singular values;
drawing a singular value proportion broken line graph by taking the number of singular values in the singular value matrix as an abscissa and the ratio as an ordinate;
judging whether the vertical coordinates corresponding to the tail branches of the singular value proportion broken line graph are all smaller than a ratio threshold value or not, and obtaining a judgment result;
if the judgment result shows that the matrix to be denoised is the zero matrix, outputting a singular value matrix, a left singular matrix and a right singular matrix of the matrix to be denoised;
if the judgment result shows no, updating the preset matrix dimension, and returning to the step of' according to the preset matrix dimension, enabling the a-th depth sounding data segment X to be denoiseda={x(a-1)*N+1,x(a-1)*N+2,…,x(a-1)*N+NAnd equally dividing into multiple sections.
Optionally, reconstructing the denoised sounding data segment and the effective sounding data segment to obtain a reconstructed denoised magnetotelluric pulse signal, specifically including:
reconstructing the denoised sounding data segment and the effective sounding data segment by using a formula w ═ lN- (l-1) · α N to obtain a reconstructed denoised magnetotelluric pulse signal;
wherein w is the length of the magnetotelluric pulse signal, l is the number of the sounding data segments, alpha is the data overlapping rate, and N is the length of the sounding data segments.
A magnetotelluric denoising system, the system comprising:
the magnetotelluric pulse signal measuring module is used for measuring magnetotelluric pulse signals of different depths of the earth by utilizing a magnetotelluric sounding method;
a sounding data segment obtaining module, configured to perform overlapping segmentation on the magnetotelluric pulse signals to obtain multiple sounding data segments;
the approximate entropy determining module of the sounding data segments is used for determining the approximate entropy of each sounding data segment based on the approximate entropy theory;
the depth measuring data segment determining module is used for determining a depth measuring data segment with approximate entropy smaller than or equal to the approximate entropy threshold value as a depth measuring data segment to be denoised and determining a depth measuring data segment with approximate entropy larger than the approximate entropy threshold value as an effective depth measuring data segment;
the matrix construction module to be denoised is used for constructing a matrix to be denoised according to the sounding data segment to be denoised;
the singular value decomposition module is used for performing singular value decomposition on the matrix to be denoised to obtain a singular value matrix, a left singular matrix and a right singular matrix of the matrix to be denoised;
a field source component matrix obtaining module, configured to multiply each diagonal element of the singular value matrix, a column vector corresponding to the left singular matrix, and a row vector corresponding to the right singular matrix, to obtain a plurality of field source component matrices of the sounding data segment to be denoised;
a component data segment obtaining module for converting each field source component matrix into a component data segment;
the approximate entropy determining module of the component data segments is used for determining the approximate entropy of each component data segment based on the approximate entropy theory;
the denoised depth measurement data section obtaining module is used for screening the component data sections of which the approximate entropy is larger than that of the depth measurement data section to be denoised, and summing the screened component data sections to obtain the denoised depth measurement data section;
and the reconstruction denoising magnetotelluric pulse signal obtaining module is used for reconstructing the denoised sounding data segment and the effective sounding data segment to obtain a reconstruction denoising magnetotelluric pulse signal.
Optionally, the depth measurement data segment obtaining module specifically includes:
a sounding data segment obtaining submodule for obtaining the magnetotelluric pulse signal x1,x2,…xwPerforming overlapping segmentation processing to obtain each depth measurement data segment Xv={x(v-1)*N+1,x(v-1)*N+2,…,x(v-1)*N+N};
Wherein x is1,x2,…xwRespectively the 1 st, 2 nd and w th magnetotelluric pulse signals, w is the length of the magnetotelluric pulse signal, x(v-1)*N+1、x(v-1)*N+2、x(v-1)*N+NThe data are respectively the 1 st, 2 nd and nth data of the v-th sounding data segment, N is the sounding data segment length, v is 1,2, …, l is the number of sounding data segments, l is (w- α N)/N (1- α), and α is the data overlap ratio.
Optionally, the approximate entropy determining module of the sounding data segment specifically includes:
the embedded dimension initialization submodule is used for initializing the embedded dimension of the Hankel matrix to be h;
the Hankel matrix construction submodule is used for respectively constructing a Hankel matrix with an embedded dimension h for each sounding data segment; each column in the hankel matrix is a mode vector;
maximum distance determination submodule for utilizing a formula
Figure GDA0003098572710000071
Determining the maximum distance between the p mode vector in the Henkel matrix and the q mode vector of the Henkel matrix;
the number counting submodule is used for counting the number of the p-th mode vector in the Hankel matrix, wherein the maximum distance between the p-th mode vector and all the mode vectors of the Hankel matrix is smaller than or equal to a mode fault tolerance threshold;
an approximate probability value determining submodule for utilizing a formula C according to the number based on the approximate probability theoryp h(r)=Np h(r)/(N-h +1), determining an approximate probability value of the p-th mode vector in the hankel matrix;
an approximate probability average determination submodule for utilizing a formula according to the approximate probability value
Figure GDA0003098572710000072
Determining an approximate probability average value of each sounding data segment under the h embedding dimension;
the circulation submodule is used for increasing the embedding dimension h by 1, returning to the step of 'respectively constructing a Hankel matrix with the embedding dimension h for each sounding data segment', and determining the approximate probability average value of each sounding data segment under the embedding dimension h + 1;
an approximate entropy determination submodule of the sounding data segment for utilizing a formula according to the approximate probability average value of each sounding data segment in the h embedding dimension and the approximate probability average value of each sounding data segment in the h +1 embedding dimension
Figure GDA0003098572710000073
Determining an approximate entropy of each sounding data segment;
wherein d ismax[y(p),y(q)]Is the maximum distance between the p-th mode vector in the Heckel matrix and the q-th mode vector in the Heckel matrix, y (p) is the p-th mode vector in the Heckel matrix, y (q) is the q-th mode vector in the Heckel matrix, x (p + delta) is the delta-th element of the p-th mode vector in the Heckel matrix, x (q + delta) is the delta-th element of the q-th mode vector in the Heckel matrix, delta is 1,2, …, h, Cp h(r) is the approximate probability value of the p-th pattern vector in the Hankel matrix, Np h(r) is the number of maximum distances less than or equal to the mode fault tolerance threshold, r is the mode fault tolerance threshold, N is the sounding data segment length,
Figure GDA0003098572710000081
is an approximate probability average of the sounding data segment in the h embedding dimension,
Figure GDA0003098572710000082
is the approximate probability average, Ae, of the sounding data segment in the h +1 embedding dimensioniIs the approximate entropy of the ith sounding data segment.
Optionally, the matrix construction module to be denoised specifically includes:
an equal division module used for dividing the a-th depth sounding data segment X to be denoised according to the preset matrix dimensiona={x(a-1)*N+1,x(a-1)*N+2,…,x(a-1)*N+NEqually dividing into a plurality of sections;
a sub-module for constructing the matrix to be denoised according to each segment after being equally divided
Figure GDA0003098572710000083
Wherein, XaFor the a-th sounding data segment to be denoised, x(a-1)*N+1、x(a-1)*N+2、x(a-1)*N+n、x(a-1)*N+1+n、x(a-1)*N+2n、xa*N+1-nAnd x(a-1)*N+NRespectively representing the 1 st, 2 nd, nth, N +1 st, 2 nth, N-N +1 th and nth data of the depth measuring data segment to be denoised, wherein N is the length of the depth measuring data segment, N is the length of a preset matrix, N is N/m, and m is the dimension of the preset matrix.
According to the specific embodiment provided by the invention, the invention discloses the following technical effects:
the invention discloses a magnetotelluric denoising method and a magnetotelluric denoising system, wherein magnetotelluric pulse signals are subjected to overlapping segmentation to obtain a plurality of sounding data sections, the approximate entropy of each sounding data section is determined, the sounding data section with the approximate entropy smaller than or equal to the approximate entropy threshold is determined as a sounding data section to be denoised, the sounding data section with the approximate entropy larger than the approximate entropy threshold is determined as an effective sounding data section, and the data sections are screened by selecting the approximate entropy before performing signal-noise separation by adopting SVD (singular value decomposition), so that the effective sounding data section is prevented from being over-processed; carrying out singular value decomposition on the sounding data segment to be denoised, multiplying a singular value matrix, a left singular matrix and a right singular matrix after the singular value decomposition to obtain a plurality of component matrices of the sounding data segment to be denoised, converting each component matrix into a component data segment, determining the approximate entropy of each component data segment, screening the component data segments of which the approximate entropy is greater than that of the sounding data segment to be denoised, summing the screened component data segments to obtain the denoised sounding data segment, and screening the decomposed components by adopting the approximate entropy to realize the purpose of denoising; and finally reconstructing the denoised depth sounding data segment and the effective depth sounding data segment to obtain a reconstructed denoised magnetotelluric pulse signal, so that the accuracy of data denoising is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings without inventive exercise.
FIG. 1 is a flow chart of a magnetotelluric denoising method provided by the present invention;
fig. 2 is a schematic diagram of a magnetotelluric denoising method provided by the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The invention aims to provide a magnetotelluric denoising method and a magnetotelluric denoising system, which are used for reducing the over-processing of data and improving the data denoising accuracy.
In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in further detail below.
The invention provides a magnetotelluric denoising method in order to reduce the loss of effective signals and combine approximate entropy screening and SVD decomposition denoising, as shown in fig. 1 and fig. 2, the method comprises the following steps:
and S101, measuring magnetotelluric pulse signals of different depths of the earth by using a magnetotelluric sounding method.
And S102, carrying out overlapping segmentation on the magnetotelluric pulse signals to obtain a plurality of sounding data segments.
S103, determining the approximate entropy of each sounding data segment based on the approximate entropy theory.
S104, determining the depth measuring data segment with the approximate entropy smaller than or equal to the approximate entropy threshold value as a depth measuring data segment to be denoised, and determining the depth measuring data segment with the approximate entropy larger than the approximate entropy threshold value as an effective depth measuring data segment. Preferably, the approximate entropy threshold is Ae0,Ae0Typically between 0.5 and 1.
And S105, constructing a matrix to be denoised according to the sounding data segment to be denoised.
And S106, performing singular value decomposition on the matrix to be denoised to obtain a singular value matrix, a left singular matrix and a right singular matrix of the matrix to be denoised.
And S107, multiplying each diagonal element of the singular value matrix, the column vector corresponding to the left singular matrix and the row vector corresponding to the right singular matrix to obtain a plurality of field source component matrixes of the sounding data segment to be denoised.
And S108, converting each field source component matrix into a component data segment.
S109, based on the approximate entropy theory, the approximate entropy of each component data segment is determined.
S110, screening the component data sections of which the approximate entropy is larger than that of the depth measuring data section to be denoised, and summing the screened component data sections to obtain the denoised depth measuring data section.
And S111, reconstructing the denoised sounding data segment and the effective sounding data segment to obtain a reconstructed denoised magnetotelluric pulse signal.
The specific process is as follows:
step S102, carrying out overlapping segmentation on the magnetotelluric pulse signals to obtain a plurality of sounding data segments, which specifically comprises the following steps:
to magnetotelluric pulsating signal x1,x2,…xwPerforming overlapping segmentation processing to obtain each depth measurement data segment Xv={x(v-1)*N+1,x(v-1)*N+2,…,x(v-1)*N+N}。
Wherein x is1,x2,…xwRespectively the 1 st, 2 nd and w th magnetotelluric pulsesSignal, w is the length of the magnetotelluric pulse signal, x(v-1)*N+1、x(v-1)*N+2、x(v-1)*N+NThe data are respectively the 1 st, 2 nd and nth data of the v-th sounding data segment, N is the sounding data segment length, v is 1,2, …, l is the number of sounding data segments, l is (w- α N)/N (1- α), and α is the data overlap ratio.
Because the multidimensional matrix of the processing object decomposed by SVD has larger requirement on the running memory when the processing object is processed by computer software, the step firstly divides the one-dimensional vector into a plurality of data segments, and each data segment is constructed into the multidimensional matrix, thereby shortening the length of the processing object, and ensuring the feasibility of running, the continuity of data and the accuracy of screening the data segments.
S103, determining the approximate entropy of each sounding data segment based on the approximate entropy theory, and specifically comprising the following steps:
initializing an embedding dimension h of a Hankel matrix (Hankel matrix);
constructing a Hankel matrix with embedded dimensions for each sounding data segment; each column in the hankel matrix is a mode vector;
using formulas
Figure GDA0003098572710000111
Determining the maximum distance between the p-th mode vector in the Hankel matrix and the q-th mode vector of the Hankel matrix;
counting the number of the p-th mode vector in the Hankel matrix, wherein the maximum distance between the p-th mode vector and all the mode vectors of the Hankel matrix is smaller than or equal to the mode fault-tolerant threshold;
based on approximate probability theory, according to the number, using formula Cp h(r)=Np h(r)/(N-h +1), determining the approximate probability value of the p-th mode vector in the hankel matrix;
using a formula based on the approximate probability value
Figure GDA0003098572710000112
Determining an approximate probability average of each sounding data segment in the h-embedding dimension;
Increasing the embedding dimension h by 1, returning to the step of constructing a Hankel matrix with the embedding dimension h for each depth measuring data segment, and determining the approximate probability average value of each depth measuring data segment under the embedding dimension h + 1;
according to the approximate probability average value of each sounding data segment in the h embedding dimension and the approximate probability average value of each sounding data segment in the h +1 embedding dimension, a formula is utilized
Figure GDA0003098572710000113
Determining an approximate entropy of each sounding data segment;
wherein d ismax[y(p),y(q)]Is the maximum distance between the p-th mode vector in the Heckel matrix and the q-th mode vector in the Heckel matrix, y (p) is the p-th mode vector in the Heckel matrix, y (q) is the q-th mode vector in the Heckel matrix, x (p + delta) is the delta-th element of the p-th mode vector in the Heckel matrix, x (q + delta) is the delta-th element of the q-th mode vector in the Heckel matrix, delta is 1,2, …, h, Cp h(r) is the approximate probability value of the p-th pattern vector in the Hankel matrix, Np h(r) is the number of maximum distances less than or equal to the mode fault tolerance threshold, r is the mode fault tolerance threshold, N is the sounding data segment length,
Figure GDA0003098572710000114
is an approximate probability average of the sounding data segment in the h embedding dimension,
Figure GDA0003098572710000115
is the approximate probability average, Ae, of the sounding data segment in the h +1 embedding dimensioniIs the approximate entropy of the ith sounding data segment.
The approximate entropy is adopted to carry out pre-screening on each segment of data before signal-noise separation, and noise has stronger directivity and more concentrated dispersion degree compared with effective signals, so that the data with better processing quality can be eliminated by the difference through the pre-screening by means of the approximate entropy, and the phenomenon that the effective signals are processed by denoising of the screening component when the data segment is the effective pure signals and the 'over-processing' of the screening component is still carried out is prevented.
Step S105, constructing a matrix to be denoised according to the sounding data segment to be denoised, which specifically comprises the following steps:
according to the preset matrix dimension, the a-th sounding data segment X to be denoiseda={x(a-1)*N+1,x(a-1)*N+2,…,x(a-1)*N+NEqually dividing into a plurality of sections;
constructing a matrix to be denoised according to each section after the equal division
Figure GDA0003098572710000121
Wherein, XaFor the a-th sounding data segment to be denoised, x(a-1)*N+1、x(a-1)*N+2、x(a-1)*N+n、x(a-1)*N+1+n、x(a-1)*N+2n、xa*N+1-nAnd x(a-1)*N+NRespectively representing the 1 st, 2 nd, nth, N +1 st, 2 nth, N-N +1 th and nth data of the depth measuring data segment to be denoised, wherein N is the length of the depth measuring data segment, N is the length of a preset matrix, N is N/m, and m is the dimension of the preset matrix.
Step S106, SVD decomposition: xa=USVTWherein U ═ U1…Um]Is a left singular matrix of m x m orthogonal,
Figure GDA0003098572710000122
is a matrix of singular values, the principal diagonal is the singular value of the matrix,
Figure GDA0003098572710000123
is Xa TXaN × n right singular matrices. U shape1、UmRespectively 1 st and m-th elements, S, in the left singular matrix1、SmRespectively representing the 1 st and m-th elements, V, of the matrix of singular values1 T、V1 TRespectively representing the 1 st and nth elements in the right singular matrix.
The dimension and length of the matrix structure are selected very key during SVD decomposition, and the suppression effect on noise is better when the length of the matrix is less than or equal to the length of the noise through repeated tests.
Step S106, then further comprising:
determining the ratio of each singular value in the singular value matrix to the sum of all singular values; delta. in FIG. 2zFor the z-th singular value, delta, in the matrix of singular valuessumThe sum of singular values in a singular value matrix is obtained;
drawing a singular value proportion broken line graph by taking the number of singular values in the singular value matrix as an abscissa and the ratio as an ordinate;
judging whether the vertical coordinates corresponding to the tail branches of the singular value proportion broken line graph are all smaller than a ratio threshold value or not, and obtaining a judgment result; preferably, the threshold ratio is 0.001. The tail branch refers to the last part of the fold line in the singular value gravity fold line graph.
If the judgment result shows that the data segment is the deep sounding data segment to be denoised, outputting a singular value matrix, a left singular matrix and a right singular matrix of the deep sounding data segment to be denoised;
if the judgment result shows no, updating the preset matrix dimension, and returning to the step of' according to the preset matrix dimension, enabling the a-th sounding data segment X to be denoiseda={x(a-1)*N+1,x(a-1)*N+2,…,x(a-1)*N+NAnd equally dividing into multiple sections.
And judging whether the selection of the matrix dimension is correct or not by observing whether the tail branch of the line graph is less than 0.001 or not according to the singular value proportion line graph, and if the tail branch value of the line graph is more than 0.001, re-assigning the matrix dimension until the proportion value is less than 0.001.
Step S107, calculating all component matrixes according to the singular values and the left and right eigenvectors, connecting the component matrixes end to obtain signals transmitted by different field source information:
Figure GDA0003098572710000131
wherein, Xa 1、Xa mRespectively being the 1 st and the m-th component matrixes of the a-th sounding data segment to be denoised.
Step S108, the step of converting each field source component matrix in the field source matrix into a component data segment is the opposite step of "constructing a matrix to be denoised according to the sounding data segment to be denoised" in step S105.
In step S109, the method of determining the approximate entropy of each component data segment based on the approximate entropy theory is the same as that of step S103.
S110, the component data segment with the approximate entropy larger than that of the sounding data segment to be denoised is regarded as effective data to be reserved, and the component data segment with the approximate entropy smaller than that is regarded as noise data. And adding and summing the reserved effective components to realize the signal-noise separation of the sounding data section to be denoised. X in FIG. 2bRepresenting a denoised sounding data segment, Xb kThe k-th component matrix is shown, where k is 1,2, …, m.
Step S111, reconstructing the denoised sounding data segment and the effective sounding data segment to obtain a reconstructed denoised magnetotelluric pulse signal, which specifically comprises the following steps:
reconstructing the denoised depth sounding data segment and the effective depth sounding data segment by using a formula w ═ lN- (l-1) · α N to obtain a reconstructed denoised magnetotelluric pulse signal;
wherein w is the length of the magnetotelluric pulse signal, l is the number of the sounding data segments, alpha is the data overlapping rate, and N is the length of the sounding data segments.
The basic principle of the invention is as follows: selecting a data segment to be processed by using approximate entropy, decomposing a time sequence signal into a singular value matrix and left and right characteristic matrix vectors by using SVD (singular value decomposition) based on the property difference of a natural field source and an interference source, and then forming a plurality of component signals from different field source information by SVD inverse transformation, and calculating the approximate entropy of the component signals, wherein the approximate entropy of effective signals is larger (representing that the signal dispersion degree is larger); and the approximate entropy of the noise is smaller (with a certain polarization direction), so as to screen the components.
Therefore, the approximate entropy and the SVD are combined, so that the data over-processing can be reduced, and the component where the effective signal is located can be accurately selected to reconstruct the de-noised data segment. Under the conditions of low data quality and complex form noise of actually measured data, the magnetotelluric denoising technology based on approximate entropy and SVD decomposition can recover the change trend of an apparent resistivity-phase curve to obtain a continuous and smooth curve form.
According to the invention, the approximate entropy is adopted to pre-screen each segment of data before signal-noise separation, and noise has stronger directivity and more concentrated dispersion degree compared with effective signals, so that the data with better quality can be prevented from being further processed by pre-screening through the difference; and a plurality of singular values are extracted through the difference between the signal amplitudes, each singular value can calculate signal components containing different information, and the purpose of denoising is achieved through screening the components, so that the technology is irrelevant to the signal-to-noise ratio of data and is relevant to the number of the extracted singular values (the more the singular values are, the more the components are, the slower the processing speed is; the less the singular values are, the less the components are, effective signals can be lost); similarly, the invention does not carry out denoising according to the form, thereby simultaneously processing large-scale noise and sudden change noise without the limit of noise form.
The invention also provides a magnetotelluric denoising system, which comprises: the device comprises a magnetotelluric pulse signal measuring module, a sounding data segment obtaining module, an approximate entropy determining module of a sounding data segment, a sounding data segment determining module to be denoised, a matrix constructing module to be denoised, a singular value decomposition module, a field source component matrix obtaining module, a component data segment obtaining module, an approximate entropy determining module of a component data segment, a denoised sounding data segment obtaining module and a reconstructed denoised magnetotelluric pulse signal obtaining module.
And the magnetotelluric pulse signal measuring module is used for measuring magnetotelluric pulse signals of different depths of the earth by utilizing a magnetotelluric sounding method.
And the sounding data segment obtaining module is used for carrying out overlapping segmentation on the magnetotelluric pulse signals to obtain a plurality of sounding data segments.
And the approximate entropy determining module of the sounding data segment is used for determining the approximate entropy of each sounding data segment based on the approximate entropy theory.
And the depth data segment to be denoised determining module is used for determining the depth data segment with the approximate entropy smaller than or equal to the approximate entropy threshold as the depth data segment to be denoised and determining the depth data segment with the approximate entropy larger than the approximate entropy threshold as the effective depth data segment.
And the matrix construction module to be denoised is used for constructing the matrix to be denoised according to the sounding data segment to be denoised.
And the singular value decomposition module is used for performing singular value decomposition on the matrix to be denoised to obtain a singular value matrix, a left singular matrix and a right singular matrix of the matrix to be denoised.
And the field source component matrix obtaining module is used for multiplying each diagonal element of the singular value matrix, the column vector corresponding to the left singular matrix and the row vector corresponding to the right singular matrix to obtain a plurality of field source component matrixes of the sounding data section to be denoised.
A component data segment obtaining module for converting each field source component matrix into a component data segment.
And the approximate entropy determining module of the component data segments is used for determining the approximate entropy of each component data segment based on the approximate entropy theory.
And the denoised depth measurement data section obtaining module is used for screening the component data sections of which the approximate entropies are larger than that of the depth measurement data section to be denoised, and summing the screened component data sections to obtain the denoised depth measurement data section.
And the reconstruction denoising magnetotelluric pulse signal obtaining module is used for reconstructing the denoised depth sounding data segment and the effective depth sounding data segment to obtain a reconstruction denoising magnetotelluric pulse signal.
The sounding data segment obtaining module specifically comprises:
a sounding data segment obtaining submodule for obtaining magnetotelluric pulse signal x1,x2,…xwPerforming overlapping segmentation processing to obtain each depth measurement data segment Xv={x(v-1)*N+1,x(v-1)*N+2,…,x(v-1)*N+N}。
Wherein x is1,x2,…xwRespectively the 1 st, 2 nd and w th magnetotelluric pulse signals, w is the length of the magnetotelluric pulse signal, x(v-1)*N+1、x(v-1)*N+2、x(v-1)*N+NThe data are respectively the 1 st, 2 nd and nth data of the v-th sounding data segment, N is the sounding data segment length, v is 1,2, …, l is the number of sounding data segments, l is (w- α N)/N (1- α), and α is the data overlap ratio.
The approximate entropy determination module of the sounding data segment specifically comprises:
and the embedding dimension initialization submodule is used for initializing the embedding dimension h of the Hankel matrix.
And the Hankel matrix construction submodule is used for respectively constructing a Hankel matrix with an embedded dimension h for each depth sounding data segment. Each column in the hankel matrix is a mode vector.
Maximum distance determination submodule for utilizing a formula
Figure GDA0003098572710000161
And determining the maximum distance between the p-th mode vector in the Hankel matrix and the q-th mode vector of the Hankel matrix.
And the number counting submodule is used for counting the number of the p-th mode vector in the Hankel matrix, wherein the maximum distance between the p-th mode vector and all the mode vectors of the Hankel matrix is smaller than or equal to the mode fault-tolerant threshold.
An approximate probability value determining submodule for utilizing a formula C according to the number based on the approximate probability theoryp h(r)=Np h(r)/(N-h +1), determining the approximate probability value of the p-th mode vector in the Hankel matrix.
An approximate probability average determination submodule for utilizing a formula based on the approximate probability value
Figure GDA0003098572710000162
And determining the approximate probability average value of each sounding data segment under the h embedding dimension.
And the circulation submodule is used for increasing the embedding dimension h by 1, returning to the step of constructing a Hankel matrix with the embedding dimension h for each sounding data segment respectively, and determining the approximate probability average value of each sounding data segment under the embedding dimension h + 1.
An approximate entropy determination submodule of the sounding data segment for utilizing a formula according to the approximate probability average value of each sounding data segment in the h embedding dimension and the approximate probability average value of each sounding data segment in the h +1 embedding dimension
Figure GDA0003098572710000163
An approximate entropy for each sounding data segment is determined.
Wherein d ismax[y(p),y(q)]Is the maximum distance between the p-th mode vector in the Heckel matrix and the q-th mode vector in the Heckel matrix, y (p) is the p-th mode vector in the Heckel matrix, y (q) is the q-th mode vector in the Heckel matrix, x (p + delta) is the delta-th element of the p-th mode vector in the Heckel matrix, x (q + delta) is the delta-th element of the q-th mode vector in the Heckel matrix, delta is 1,2, …, h, Cp h(r) is the approximate probability value of the p-th pattern vector in the Hankel matrix, Np h(r) is the number of maximum distances less than or equal to the mode fault tolerance threshold, r is the mode fault tolerance threshold, N is the sounding data segment length,
Figure GDA0003098572710000164
is an approximate probability average of the sounding data segment in the h embedding dimension,
Figure GDA0003098572710000165
is the approximate probability average, Ae, of the sounding data segment in the h +1 embedding dimensioniIs the approximate entropy of the ith sounding data segment.
The matrix construction module to be denoised specifically comprises:
an equal division module used for dividing the a-th depth sounding data segment X to be denoised according to the preset matrix dimensiona={x(a-1)*N+1,x(a-1)*N+2,…,x(a-1)*N+NAnd equally dividing into a plurality of sections.
A sub-module for constructing the matrix to be denoised according to each segment after being equally divided
Figure GDA0003098572710000171
Wherein, XaFor the a-th sounding data segment to be denoised, x(a-1)*N+1、x(a-1)*N+2、x(a-1)*N+n、x(a-1)*N+1+n、x(a-1)*N+2n、xa*N+1-nAnd x(a-1)*N+NRespectively representing the 1 st, 2 nd, nth, N +1 st, 2 nth, N-N +1 th and nth data of the depth measuring data segment to be denoised, wherein N is the length of the depth measuring data segment, N is the length of a preset matrix, N is N/m, and m is the dimension of the preset matrix.
The magnetotelluric denoising technology based on approximate entropy and SVD can reduce the phenomenon of 'over-processing' data under certain conditions; the requirement on the signal-to-noise ratio of data is low; the noise with complex forms can be suppressed.
The embodiments in the present description are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. For the system disclosed by the embodiment, the description is relatively simple because the system corresponds to the method disclosed by the embodiment, and the relevant points can be referred to the method part for description.
The principles and embodiments of the present invention have been described herein using specific examples, which are provided only to help understand the method and the core concept of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, the specific embodiments and the application range may be changed. In view of the above, the present disclosure should not be construed as limiting the invention.

Claims (8)

1.一种大地电磁去噪方法,其特征在于,所述方法包括:1. A magnetotelluric denoising method, characterized in that the method comprises: 利用大地电磁测深法测量大地不同深度的大地电磁脉动信号;Using the magnetotelluric sounding method to measure the magnetotelluric pulsation signals at different depths of the earth; 对所述大地电磁脉动信号进行重叠分段,获得多个测深数据段;performing overlapping segmentation on the magnetotelluric pulsation signal to obtain a plurality of sounding data segments; 基于近似熵理论,确定每个测深数据段的近似熵;Based on the approximate entropy theory, determine the approximate entropy of each bathymetric data segment; 将近似熵小于或等于近似熵阈值的测深数据段确定为待去噪测深数据段,并将近似熵大于近似熵阈值的测深数据段确定为有效测深数据段;Determine the sounding data segment whose approximate entropy is less than or equal to the approximate entropy threshold as the sounding data segment to be denoised, and determine the sounding data segment whose approximate entropy is greater than the approximate entropy threshold as the effective sounding data segment; 根据所述待去噪测深数据段,构造待去噪矩阵,具体包括:According to the sounding data segment to be denoised, construct a matrix to be denoised, which specifically includes: 根据预设矩阵维数,将第a个待去噪测深数据段Xa={x(a-1)*N+1,x(a-1)*N+2,…,x(a-1)*N+N,}等分为多段;According to the preset matrix dimension, the a-th sounding data segment to be denoised X a ={x (a-1)*N+1 ,x (a-1)*N+2 ,...,x (a- 1) *N+N ,} is divided into multiple segments; 根据等分后的每一段,构造待去噪矩阵
Figure FDA0003098572700000011
According to each segment after equal division, construct the matrix to be denoised
Figure FDA0003098572700000011
其中,Xa为第a个待去噪测深数据段,x(a-1)*N+1、x(a-1)*N+2、x(a-1)*N+n、x(a-1)*N+1+n、x(a-1)*N+2n、xa*N+1-n和x(a-1)*N+N分别表示第a个待去噪测深数据段第1个、第2个、第n个、第n+1个、第2n个、第N-n+1个和第N个数据,N为测深数据段长度,n为预设矩阵长度,n=N/m,m为预设矩阵维数;Among them, X a is the a-th sounding data segment to be denoised, x (a-1)*N+1 , x (a-1)*N+2 , x (a-1)*N+n , x (a-1)*N+1+n , x (a-1)*N+2n , x a*N+1-n and x (a-1)*N+N respectively represent the a-th denoising The 1st, 2nd, nth, n+1th, 2nth, N-n+1th and Nth data of the sounding data segment, N is the length of the sounding data segment, n is the prediction Set the matrix length, n=N/m, m is the preset matrix dimension; 对所述待去噪矩阵进行奇异值分解,获得所述待去噪矩阵的奇异值矩阵、左奇异矩阵和右奇异矩阵;Perform singular value decomposition on the matrix to be denoised to obtain singular value matrix, left singular matrix and right singular matrix of the matrix to be denoised; 将所述奇异值矩阵的每个对角线元素、所述左奇异矩阵对应的列向量和所述右奇异矩阵对应的行向量相乘,获得所述待去噪测深数据段的多个场源分量矩阵;Multiply each diagonal element of the singular value matrix, the column vector corresponding to the left singular matrix, and the row vector corresponding to the right singular matrix to obtain multiple fields of the sounding data segment to be denoised source component matrix; 将每个场源分量矩阵转变为分量数据段;Convert each field source component matrix into component data segments; 基于近似熵理论,确定每个分量数据段的近似熵;Based on the approximate entropy theory, determine the approximate entropy of each component data segment; 筛选分量数据段的近似熵大于所述待去噪测深数据段的近似熵的分量数据段,并将筛选出来的分量数据段求和,获得去噪后的测深数据段;Screening component data segments whose approximate entropy is greater than the approximate entropy of the sounding data segment to be denoised, and summing the selected component data segments to obtain a denoised sounding data segment; 将所述去噪后的测深数据段和所述有效测深数据段进行重构,获得重构去噪大地电磁脉动信号。Reconstructing the denoised bathymetric data segment and the effective bathymetry data segment to obtain a reconstructed denoised magnetotelluric pulsation signal.
2.根据权利要求1所述的大地电磁去噪方法,其特征在于,所述对所述大地电磁脉动信号进行重叠分段,获得多个测深数据段,具体包括:2. The magnetotelluric denoising method according to claim 1, wherein the overlapping segmentation of the magnetotelluric pulsation signal to obtain a plurality of sounding data segments, specifically comprising: 对所述大地电磁脉动信号x1,x2,…xw进行重叠分段处理,获得每个测深数据段Xv={x(v-1)*N+1,x(v-1)*N+2,…,x(v-1)*N+N};Perform overlapping segmentation processing on the magnetotelluric pulsation signals x 1 , x 2 , . . . x w to obtain each bathymetric data segment X v ={x (v-1)*N+1 ,x (v-1) *N+2 ,…,x (v-1)*N+N }; 其中,x1,x2,…xw分别为第1个、第2个、第w个大地电磁脉动信号,w为大地电磁脉动信号的长度,x(v-1)*N+1、x(v-1)*N+2、x(v-1)*N+N分别为第v个测深数据段的第1个、第2个和第N个数据,N为测深数据段长度,v=1,2,…,l,l为测深数据段的个数,l=(w-αN)/N(1-α),α为数据重叠率。Among them, x 1 , x 2 ,...x w are the 1st, 2nd, and wth magnetotelluric pulsation signals, respectively, w is the length of the magnetotelluric pulsation signal, x (v-1)*N+1 , x (v-1)*N+2 , x (v-1)*N+N are the 1st, 2nd and Nth data of the vth sounding data segment respectively, N is the length of the sounding data segment , v=1,2,...,l, l is the number of sounding data segments, l=(w-αN)/N(1-α), and α is the data overlap rate. 3.根据权利要求1所述的大地电磁去噪方法,其特征在于,所述基于近似熵理论,确定每个测深数据段的近似熵,具体包括:3. The magnetotelluric denoising method according to claim 1, wherein the approximate entropy of each bathymetric data segment is determined based on the approximate entropy theory, specifically comprising: 初始化汉克尔矩阵的嵌入维数为h;Initialize the embedding dimension of the Hankel matrix to h; 对每个测深数据段分别构造所述嵌入维数的汉克尔矩阵;所述汉克尔矩阵中的每一列为一个模式向量;Constructing the Hankel matrix of the embedded dimension for each bathymetric data segment; each column in the Hankel matrix is a pattern vector; 利用公式
Figure FDA0003098572700000021
确定所述汉克尔矩阵中第p个模式向量与所述汉克尔矩阵的第q个模式向量的最大距离;
Use the formula
Figure FDA0003098572700000021
determining the maximum distance between the p-th mode vector in the Hankel matrix and the q-th mode vector of the Hankel matrix;
统计所述汉克尔矩阵中第p个模式向量分别与所述汉克尔矩阵的所有模式向量的最大距离小于或等于模式容错阈值的个数;Counting the number that the maximum distance between the p-th mode vector in the Hankel matrix and all mode vectors of the Hankel matrix is less than or equal to the mode fault tolerance threshold; 基于近似概率理论,根据所述个数,利用公式Cp h(r)=Np h(r)/(N-h+1),确定第p个模式向量在所述汉克尔矩阵的近似概率值;Based on the approximate probability theory, according to the number, using the formula C p h (r)=N p h (r)/(N-h+1), determine the approximation of the p-th mode vector in the Hankel matrix probability value; 根据所述近似概率值,利用公式
Figure FDA0003098572700000022
确定每个测深数据段在h嵌入维数下的近似概率平均值;
According to the approximate probability value, using the formula
Figure FDA0003098572700000022
Determine the approximate probability mean of each bathymetric data segment under the h embedding dimension;
令嵌入维数h增加1,返回步骤“对每个测深数据段分别构造嵌入维数为h的汉克尔矩阵”,确定每个测深数据段在h+1嵌入维数下的近似概率平均值;Increase the embedding dimension h by 1, and return to the step "Construct a Hankel matrix with an embedding dimension h for each bathymetric data segment", and determine the approximate probability of each bathymetric data segment under the h+1 embedding dimension average value; 根据每个测深数据段在h嵌入维数下的近似概率平均值和每个测深数据段在h+1嵌入维数下的近似概率平均值,利用公式
Figure FDA0003098572700000023
确定每个测深数据段的近似熵;
Using the formula
Figure FDA0003098572700000023
Determine the approximate entropy of each bathymetric data segment;
其中,dmax[y(p),y(q)]为汉克尔矩阵中第p个模式向量与汉克尔矩阵的第q个模式向量的最大距离,y(p)为汉克尔矩阵中第p个模式向量,y(q)为汉克尔矩阵的第q个模式向量,x(p+δ)为汉克尔矩阵中第p个模式向量的第δ个元素,x(q+δ)为汉克尔矩阵中第q个模式向量的第δ个元素,δ=1,2,…,h,Cp h(r)为第p个模式向量在汉克尔矩阵的近似概率值,Np h(r)为最大距离小于或等于模式容错阈值的个数,r为模式容错阈值,N为测深数据段长度,
Figure FDA0003098572700000031
为测深数据段在h嵌入维数下的近似概率平均值,
Figure FDA0003098572700000032
为测深数据段在h+1嵌入维数下的近似概率平均值,Aei为第i个测深数据段的近似熵。
Among them, d max [y(p), y(q)] is the maximum distance between the p-th mode vector in the Hankel matrix and the q-th mode vector of the Hankel matrix, and y(p) is the Hankel matrix In the p-th mode vector, y(q) is the q-th mode vector of the Hankel matrix, x(p+δ) is the δ-th element of the p-th mode vector in the Hankel matrix, x(q+ δ) is the δth element of the qth mode vector in the Hankel matrix, δ=1,2,...,h, C p h (r) is the approximate probability value of the pth mode vector in the Hankel matrix , N p h (r) is the number of the maximum distance less than or equal to the pattern fault tolerance threshold, r is the pattern fault tolerance threshold, N is the length of the sounding data segment,
Figure FDA0003098572700000031
is the approximate probability mean of the bathymetric data segment under the h embedding dimension,
Figure FDA0003098572700000032
is the approximate probability mean of the bathymetric data segment under the h+1 embedding dimension, and Ae i is the approximate entropy of the i-th bathymetric data segment.
4.根据权利要求1所述的大地电磁去噪方法,其特征在于,所述对所述待去噪矩阵进行奇异值分解,获得所述待去噪矩阵的奇异值矩阵、左奇异矩阵和右奇异矩阵,之后还包括:4. The magnetotelluric denoising method according to claim 1, characterized in that, performing singular value decomposition on the matrix to be denoised to obtain singular value matrix, left singular matrix and right singular value of the matrix to be denoised Singular matrices, followed by: 确定所述奇异值矩阵中每个奇异值与所有奇异值总和的比值;determining the ratio of each singular value in the singular value matrix to the sum of all singular values; 以所述奇异值矩阵中奇异值的个数为横坐标,以所述比值为纵坐标,绘制奇异值比重折线图;Taking the number of singular values in the singular value matrix as the abscissa, and taking the ratio as the ordinate, draw a line graph of the proportion of singular values; 判断所述奇异值比重折线图的尾支对应的纵坐标是否均小于比值阈值,获得判断结果;Judging whether the ordinates corresponding to the tail branch of the singular value proportion line graph are all smaller than the ratio threshold, and obtaining the judgment result; 若所述判断结果表示是,则输出所述待去噪矩阵的奇异值矩阵、左奇异矩阵和右奇异矩阵;If the judgment result indicates yes, output the singular value matrix, left singular matrix and right singular matrix of the matrix to be denoised; 若所述判断结果表示否,则更新所述预设矩阵维数,返回步骤“根据预设矩阵维数,将第a个待去噪测深数据段Xa={x(a-1)*N+1,x(a-1)*N+2,…,x(a-1)*N+N,}等分为多段”。If the judgment result indicates no, then update the preset matrix dimension, and return to the step "According to the preset matrix dimension, the a-th sounding data segment to be denoised X a ={x (a-1)* N+1 ,x (a-1)*N+2 ,…,x (a-1)*N+N ,} is divided into multiple segments”. 5.根据权利要求1所述的大地电磁去噪方法,其特征在于,所述将所述去噪后的测深数据段和所述有效测深数据段进行重构,获得重构去噪大地电磁脉动信号,具体包括:5 . The method for denoising magnetotelluric according to claim 1 , wherein the denoised sounding data segment and the effective bathymetric data segment are reconstructed to obtain a reconstructed denoised geodetic data segment. 6 . Electromagnetic pulse signals, including: 利用公式w=lN-(l-1)·αN,将所述去噪后的测深数据段和所述有效测深数据段进行重构,获得重构去噪大地电磁脉动信号;Using the formula w=lN-(l-1)·αN, reconstruct the denoised bathymetric data segment and the effective bathymetry data segment to obtain a reconstructed denoised electromagnetic pulsation signal; 其中,w为大地电磁脉动信号的长度,l为测深数据段的个数,α为数据重叠率,N为测深数据段长度。Among them, w is the length of the magnetotelluric pulsation signal, l is the number of sounding data segments, α is the data overlap rate, and N is the length of the sounding data segment. 6.一种大地电磁去噪系统,其特征在于,所述系统包括:6. A magnetotelluric denoising system, wherein the system comprises: 大地电磁脉动信号测量模块,用于利用大地电磁测深法测量大地不同深度的大地电磁脉动信号;The magnetotelluric pulsation signal measurement module is used to measure the magnetotelluric pulsation signal at different depths of the earth by using the magnetotelluric sounding method; 测深数据段获得模块,用于对所述大地电磁脉动信号进行重叠分段,获得多个测深数据段;a sounding data segment obtaining module, used for overlapping and segmenting the magnetotelluric pulsation signal to obtain a plurality of sounding data segments; 测深数据段的近似熵确定模块,用于基于近似熵理论,确定每个测深数据段的近似熵;The approximate entropy determination module of the sounding data segment is used to determine the approximate entropy of each sounding data segment based on the approximate entropy theory; 待去噪测深数据段确定模块,用于将近似熵小于或等于近似熵阈值的测深数据段确定为待去噪测深数据段,并将近似熵大于近似熵阈值的测深数据段确定为有效测深数据段;The sounding data segment determination module to be denoised is used to determine the sounding data segment whose approximate entropy is less than or equal to the approximate entropy threshold as the sounding data segment to be denoised, and determine the sounding data segment whose approximate entropy is greater than the approximate entropy threshold is a valid sounding data segment; 待去噪矩阵构造模块,用于根据所述待去噪测深数据段,构造待去噪矩阵,具体包括:A matrix construction module to be de-noised, configured to construct a matrix to be de-noised according to the sounding data segment to be de-noised, specifically including: 等分子模块,用于根据预设矩阵维数,将第a个待去噪测深数据段Xa={x(a-1)*N+1,x(a-1)*N+2,…,x(a-1)*N+N,}等分为多段;The equimolar module is used to convert the a-th sounding data segment to be denoised X a ={x (a-1)*N+1 ,x (a-1)*N+2 , according to the preset matrix dimension, ...,x (a-1)*N+N ,} is divided into multiple segments; 待去噪矩阵构造子模块,用于根据等分后的每一段,构造待去噪矩阵
Figure FDA0003098572700000041
The sub-module of the matrix to be denoised is used to construct the matrix to be denoised according to each segment after equal division
Figure FDA0003098572700000041
其中,Xa为第a个待去噪测深数据段,x(a-1)*N+1、x(a-1)*N+2、x(a-1)*N+n、x(a-1)*N+1+n、x(a-1)*N+2n、xa*N+1-n和x(a-1)*N+N分别表示第a个待去噪测深数据段第1个、第2个、第n个、第n+1个、第2n个、第N-n+1个和第N个数据,N为测深数据段长度,n为预设矩阵长度,n=N/m,m为预设矩阵维数;Among them, X a is the a-th sounding data segment to be denoised, x (a-1)*N+1 , x (a-1)*N+2 , x (a-1)*N+n , x (a-1)*N+1+n , x (a-1)*N+2n , x a*N+1-n and x (a-1)*N+N respectively represent the a-th denoising The 1st, 2nd, nth, n+1th, 2nth, N-n+1th and Nth data of the sounding data segment, N is the length of the sounding data segment, n is the prediction Set the matrix length, n=N/m, m is the preset matrix dimension; 奇异值分解模块,用于对所述待去噪矩阵进行奇异值分解,获得所述待去噪矩阵的奇异值矩阵、左奇异矩阵和右奇异矩阵;a singular value decomposition module, configured to perform singular value decomposition on the matrix to be denoised to obtain a singular value matrix, a left singular matrix and a right singular matrix of the matrix to be denoised; 场源分量矩阵获得模块,用于将所述奇异值矩阵的每个对角线元素、所述左奇异矩阵对应的列向量和所述右奇异矩阵对应的行向量相乘,获得所述待去噪测深数据段的多个场源分量矩阵;The field source component matrix obtaining module is used to multiply each diagonal element of the singular value matrix, the column vector corresponding to the left singular matrix and the row vector corresponding to the right singular matrix to obtain the to-be-removed Multiple field source component matrices for noisy bathymetric data segments; 分量数据段获得模块,用于将每个场源分量矩阵转变为分量数据段;a component data segment obtaining module for converting each field source component matrix into a component data segment; 分量数据段的近似熵确定模块,用于基于近似熵理论,确定每个分量数据段的近似熵;The approximate entropy determination module of the component data segment is used to determine the approximate entropy of each component data segment based on the approximate entropy theory; 去噪后的测深数据段获得模块,用于筛选分量数据段的近似熵大于所述待去噪测深数据段的近似熵的分量数据段,并将筛选出来的分量数据段求和,获得去噪后的测深数据段;The denoised sounding data segment obtaining module is used to filter the component data segment whose approximate entropy is greater than the approximate entropy of the sounding data segment to be denoised, and sum the selected component data segments to obtain The sounding data segment after denoising; 重构去噪大地电磁脉动信号获得模块,用于将所述去噪后的测深数据段和所述有效测深数据段进行重构,获得重构去噪大地电磁脉动信号。The reconstructed and denoised magnetotelluric pulsation signal obtaining module is used for reconstructing the denoised sounding data segment and the effective sounding data segment to obtain a reconstructed and denoised magnetotelluric pulsation signal.
7.根据权利要求6所述的大地电磁去噪系统,其特征在于,所述测深数据段获得模块,具体包括:7. The magnetotelluric denoising system according to claim 6, wherein the sounding data segment obtaining module specifically comprises: 测深数据段获得子模块,用于对所述大地电磁脉动信号x1,x2,…xw进行重叠分段处理,获得每个测深数据段Xv={x(v-1)*N+1,x(v-1)*N+2,…,x(v-1)*N+N};The sounding data segment obtaining submodule is used to perform overlapping segmentation processing on the magnetotelluric pulsation signals x 1 , x 2 , . . . x w to obtain each sounding data segment X v ={x (v-1)* N+1 ,x (v-1)*N+2 ,...,x (v-1)*N+N }; 其中,x1,x2,…xw分别为第1个、第2个、第w个大地电磁脉动信号,w为大地电磁脉动信号的长度,x(v-1)*N+1、x(v-1)*N+2、x(v-1)*N+N分别为第v个测深数据段的第1个、第2个和第N个数据,N为测深数据段长度,v=1,2,…,l,l为测深数据段的个数,l=(w-αN)/N(1-α),α为数据重叠率。Among them, x 1 , x 2 ,...x w are the 1st, 2nd, and wth magnetotelluric pulsation signals, respectively, w is the length of the magnetotelluric pulsation signal, x (v-1)*N+1 , x (v-1)*N+2 , x (v-1)*N+N are the 1st, 2nd and Nth data of the vth sounding data segment respectively, N is the length of the sounding data segment , v=1,2,...,l, l is the number of sounding data segments, l=(w-αN)/N(1-α), and α is the data overlap rate. 8.根据权利要求6所述的大地电磁去噪系统,其特征在于,所述测深数据段的近似熵确定模块,具体包括:8. The magnetotelluric denoising system according to claim 6, wherein the approximate entropy determination module of the bathymetric data segment specifically comprises: 嵌入维数初始化子模块,用于初始化汉克尔矩阵的嵌入维数为h;Embedding dimension initialization sub-module, which is used to initialize the embedding dimension of the Hankel matrix to h; 汉克尔矩阵构造子模块,用于对每个测深数据段分别构造嵌入维数为h的汉克尔矩阵;所述汉克尔矩阵中的每一列为一个模式向量;The Hankel matrix construction submodule is used to construct a Hankel matrix with an embedded dimension h for each bathymetric data segment; each column in the Hankel matrix is a pattern vector; 最大距离确定子模块,用于利用公式
Figure FDA0003098572700000051
确定所述汉克尔矩阵中第p个模式向量与所述汉克尔矩阵的第q个模式向量的最大距离;
Maximum distance determination sub-module for utilizing the formula
Figure FDA0003098572700000051
determining the maximum distance between the p-th mode vector in the Hankel matrix and the q-th mode vector of the Hankel matrix;
个数统计子模块,用于统计所述汉克尔矩阵中第p个模式向量分别与所述汉克尔矩阵的所有模式向量的最大距离小于或等于模式容错阈值的个数;The number statistics sub-module is used to count the number of the p-th mode vector in the Hankel matrix and all mode vectors of the Hankel matrix whose maximum distance is less than or equal to the mode fault tolerance threshold; 近似概率值确定子模块,用于基于近似概率理论,根据所述个数,利用公式Cp h(r)=Np h(r)/(N-h+1),确定第p个模式向量在所述汉克尔矩阵的近似概率值;The approximate probability value determination submodule is used to determine the p-th pattern vector based on the approximate probability theory and according to the number and using the formula C p h (r)=N p h (r)/(N-h+1) the approximate probability value in the Hankel matrix; 近似概率平均值确定子模块,用于根据所述近似概率值,利用公式
Figure FDA0003098572700000061
确定每个测深数据段在h嵌入维数下的近似概率平均值;
The approximate probability mean value determination sub-module is used for using the formula according to the approximate probability value
Figure FDA0003098572700000061
Determine the approximate probability mean of each bathymetric data segment under the h embedding dimension;
循环子模块,用于令嵌入维数h增加1,返回步骤“对每个测深数据段分别构造嵌入维数为h的汉克尔矩阵”,确定每个测深数据段在h+1嵌入维数下的近似概率平均值;The loop sub-module is used to increase the embedding dimension h by 1, and return to the step "construct a Hankel matrix with an embedding dimension h for each bathymetric data segment", and determine that each bathymetric data segment is embedded in h+1 Approximate probability mean in dimension; 测深数据段的近似熵确定子模块,用于根据每个测深数据段在h嵌入维数下的近似概率平均值和每个测深数据段在h+1嵌入维数下的近似概率平均值,利用公式
Figure FDA0003098572700000062
确定每个测深数据段的近似熵;
The approximate entropy determination sub-module of the bathymetric data segment is used to determine the approximate probability average of each bathymetric data segment under the h embedding dimension and the approximate probability average of each bathymetric data segment under the h+1 embedding dimension value, using the formula
Figure FDA0003098572700000062
Determine the approximate entropy of each bathymetric data segment;
其中,dmax[y(p),y(q)]为汉克尔矩阵中第p个模式向量与汉克尔矩阵的第q个模式向量的最大距离,y(p)为汉克尔矩阵中第p个模式向量,y(q)为汉克尔矩阵的第q个模式向量,x(p+δ)为汉克尔矩阵中第p个模式向量的第δ个元素,x(q+δ)为汉克尔矩阵中第q个模式向量的第δ个元素,δ=1,2,…,h,Cp h(r)为第p个模式向量在汉克尔矩阵的近似概率值,Np h(r)为最大距离小于或等于模式容错阈值的个数,r为模式容错阈值,N为测深数据段长度,
Figure FDA0003098572700000063
为测深数据段在h嵌入维数下的近似概率平均值,
Figure FDA0003098572700000064
为测深数据段在h+1嵌入维数下的近似概率平均值,Aei为第i个测深数据段的近似熵。
Among them, d max [y(p), y(q)] is the maximum distance between the p-th mode vector in the Hankel matrix and the q-th mode vector of the Hankel matrix, and y(p) is the Hankel matrix In the p-th mode vector, y(q) is the q-th mode vector of the Hankel matrix, x(p+δ) is the δ-th element of the p-th mode vector in the Hankel matrix, x(q+ δ) is the δth element of the qth mode vector in the Hankel matrix, δ=1,2,...,h, C p h (r) is the approximate probability value of the pth mode vector in the Hankel matrix , N p h (r) is the number of the maximum distance less than or equal to the pattern fault tolerance threshold, r is the pattern fault tolerance threshold, N is the length of the sounding data segment,
Figure FDA0003098572700000063
is the approximate probability mean of the bathymetric data segment under the h embedding dimension,
Figure FDA0003098572700000064
is the approximate probability mean of the bathymetric data segment under the h+1 embedding dimension, and Ae i is the approximate entropy of the i-th bathymetric data segment.
CN202011309115.0A 2020-11-20 2020-11-20 A kind of magnetotelluric denoising method and system Expired - Fee Related CN112285793B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011309115.0A CN112285793B (en) 2020-11-20 2020-11-20 A kind of magnetotelluric denoising method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011309115.0A CN112285793B (en) 2020-11-20 2020-11-20 A kind of magnetotelluric denoising method and system

Publications (2)

Publication Number Publication Date
CN112285793A CN112285793A (en) 2021-01-29
CN112285793B true CN112285793B (en) 2021-08-13

Family

ID=74398495

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011309115.0A Expired - Fee Related CN112285793B (en) 2020-11-20 2020-11-20 A kind of magnetotelluric denoising method and system

Country Status (1)

Country Link
CN (1) CN112285793B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113568058B (en) * 2021-07-20 2022-06-03 湖南师范大学 A method and system for separation of magnetotelluric signal-to-noise based on multi-resolution singular value decomposition
CN114239651B (en) * 2021-12-15 2024-10-18 吉林大学 Earth electromagnetic denoising method and system
CN119758800B (en) * 2024-11-19 2025-07-15 江苏赫玛信息科技有限公司 Intelligent manufacturing process data acquisition method and system

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105467460A (en) * 2015-12-28 2016-04-06 中国石油天然气集团公司 Method and device for electromagnetic prospecting

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090265111A1 (en) * 2008-04-16 2009-10-22 Kjt Enterprises, Inc. Signal processing method for marine electromagnetic signals
CN103584872B (en) * 2013-10-29 2015-03-25 燕山大学 Psychological stress assessment method based on multi-physiological parameter fusion
CN103837898B (en) * 2014-02-24 2016-08-17 吉林大学 High-density electric near-end dipole electromagnetic sounding method
CN111709279B (en) * 2020-04-30 2023-07-21 天津城建大学 An Algorithm for Separating Microseismic Noise Mixed Signals Using SVD-EMD Algorithm

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105467460A (en) * 2015-12-28 2016-04-06 中国石油天然气集团公司 Method and device for electromagnetic prospecting

Also Published As

Publication number Publication date
CN112285793A (en) 2021-01-29

Similar Documents

Publication Publication Date Title
Dong et al. Non-iterative denoising algorithm for mechanical vibration signal using spectral graph wavelet transform and detrended fluctuation analysis
CN110865357B (en) Laser radar echo signal noise reduction method based on parameter optimization VMD
CN112285793B (en) A kind of magnetotelluric denoising method and system
Saad et al. Unsupervised deep learning for single-channel earthquake data denoising and its applications in event detection and fully automatic location
CN108345033B (en) A first-arrival detection method for microseismic signals in time-frequency domain
CN113568058B (en) A method and system for separation of magnetotelluric signal-to-noise based on multi-resolution singular value decomposition
CN110646851B (en) An adaptive threshold seismic random noise suppression method based on Shearlet transform
CN110031899A (en) Compressed sensing based weak signal extraction algorithm
CN105676292A (en) 3D earthquake data de-noising method based on 2D curvelet transform
CN107179550B (en) A kind of seismic signal zero phase deconvolution method of data-driven
CN109633761B (en) A method for reducing power frequency noise of magnetic resonance signal based on wavelet transform modulus maximum method
CN108961181A (en) A kind of ground penetrating radar image denoising method based on shearlet transformation
Il et al. An appropriate thresholding method of wavelet denoising for dropping ambient noise
CN114091538B (en) A discriminant loss convolutional neural network intelligent denoising method based on signal characteristics
CN106405504B (en) The Coherent Noise in GPR Record denoising method of combined shearing wave conversion and singular value decomposition
CN117076858A (en) A method and system for suppressing strong low-frequency electromagnetic interference based on deep learning
CN107015124B (en) A Method of Partial Discharge Signal Interference Suppression Based on Frame Adaptive Sparse Decomposition
CN116520317B (en) Ground Penetrating Radar Signal Denoising Method Combining Two-Dimensional VMD and DT-CWT
Wang et al. A joint framework for seismic signal denoising using total generalized variation and shearlet transform
CN112817056A (en) Magnetotelluric signal denoising method and system
CN116401509A (en) Underwater ultrasonic signal denoising method based on improved EWT-FastICA combination
CN113655534A (en) Noise suppression method of NMR FID signal based on multilinear singular value tensor decomposition
Kim et al. Statistical modeling and denoising of microseismic signal for dropping ambient noise in wavelet domain
CN109782346B (en) A method of collecting footprints based on morphological component analysis
CN104765069A (en) Method of suppressing adjacent shot interference in case of synchronous excitation acquisition

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20210813

CF01 Termination of patent right due to non-payment of annual fee