CN115290130B - Distributed information estimation method based on multivariate probability quantization - Google Patents
Distributed information estimation method based on multivariate probability quantization Download PDFInfo
- Publication number
- CN115290130B CN115290130B CN202211229494.1A CN202211229494A CN115290130B CN 115290130 B CN115290130 B CN 115290130B CN 202211229494 A CN202211229494 A CN 202211229494A CN 115290130 B CN115290130 B CN 115290130B
- Authority
- CN
- China
- Prior art keywords
- probability
- quantization
- multivariate
- data
- function
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01D—MEASURING NOT SPECIALLY ADAPTED FOR A SPECIFIC VARIABLE; ARRANGEMENTS FOR MEASURING TWO OR MORE VARIABLES NOT COVERED IN A SINGLE OTHER SUBCLASS; TARIFF METERING APPARATUS; MEASURING OR TESTING NOT OTHERWISE PROVIDED FOR
- G01D21/00—Measuring or testing not otherwise provided for
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16Y—INFORMATION AND COMMUNICATION TECHNOLOGY SPECIALLY ADAPTED FOR THE INTERNET OF THINGS [IoT]
- G16Y20/00—Information sensed or collected by the things
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16Y—INFORMATION AND COMMUNICATION TECHNOLOGY SPECIALLY ADAPTED FOR THE INTERNET OF THINGS [IoT]
- G16Y20/00—Information sensed or collected by the things
- G16Y20/10—Information sensed or collected by the things relating to the environment, e.g. temperature; relating to location
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16Y—INFORMATION AND COMMUNICATION TECHNOLOGY SPECIALLY ADAPTED FOR THE INTERNET OF THINGS [IoT]
- G16Y40/00—IoT characterised by the purpose of the information processing
- G16Y40/10—Detection; Monitoring
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16Y—INFORMATION AND COMMUNICATION TECHNOLOGY SPECIALLY ADAPTED FOR THE INTERNET OF THINGS [IoT]
- G16Y40/00—IoT characterised by the purpose of the information processing
- G16Y40/20—Analytics; Diagnosis
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16Y—INFORMATION AND COMMUNICATION TECHNOLOGY SPECIALLY ADAPTED FOR THE INTERNET OF THINGS [IoT]
- G16Y40/00—IoT characterised by the purpose of the information processing
- G16Y40/60—Positioning; Navigation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/30—Services specially adapted for particular environments, situations or purposes
- H04W4/38—Services specially adapted for particular environments, situations or purposes for collecting sensor information
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Landscapes
- Engineering & Computer Science (AREA)
- Computing Systems (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Biomedical Technology (AREA)
- Environmental & Geological Engineering (AREA)
- Toxicology (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Arrangements For Transmission Of Measured Signals (AREA)
Abstract
本发明公开了一种基于多元概率量化的分布式信息估计方法,包括以下步骤:S1.构建分布式信息估计场景:包括一个位于无线通信网络中心的融合中心FC和多个分布在无线通信网络边缘的传感器;S2.构建传感器对本地观测数据进行量化的多元概率量化器;S3.优化多元量化概率函数的设计参数
;S4.融合中心FC设计量化融合估计器并进行优化得到最优估计函数;S5.基于和的多元概率量化分布式信息估计。本发明能够适应量化结果存在多元的情况,并保持较高的估计性能。The invention discloses a distributed information estimation method based on multivariate probability quantification, which includes the following steps: S1. Construct a distributed information estimation scene: including a fusion center FC located at the center of the wireless communication network and multiple distributed at the edge of the wireless communication network S2. Construct a multivariate probability quantizer for quantifying the local observation data by the sensor; S3. Optimize the design parameters of the multivariate quantization probability function
; S4. The fusion center FC designs a quantized fusion estimator and optimizes it to obtain the optimal estimation function ; S5. Based on and Multivariate Probability Quantification for Distributed Information Estimation. The present invention can adapt to the situation that there are multiple quantization results, and maintains high estimation performance.Description
技术领域technical field
本发明涉及分布式信息估计,特别是涉及一种基于多元概率量化的分布式信息估计方法。The invention relates to distributed information estimation, in particular to a distributed information estimation method based on multivariate probability quantization.
背景技术Background technique
基于量化数据的分布式信息估计一直是一个活跃的研究领域。在典型的分布式估计框架中,本地传感器将对原始信息的本地观测数据发送到融合中心。融合中心接收从不同本地传感器发送过来的数据,利用估计算法来估计未知的原始信息。然而,由于带宽/能量限制,传感器上的本地观测数据通常在传输到融合中心之前需要被量化。所有传感器使用相同的量化器是一种被广泛采用的方案,因为它简化了设计问题。Estimation of distributed information from quantitative data has been an active research area. In a typical distributed estimation framework, local sensors send local observations of raw information to a fusion center. The fusion center receives data sent from different local sensors, and uses estimation algorithms to estimate unknown raw information. However, due to bandwidth/energy limitations, local observations on sensors usually need to be quantized before being transmitted to the fusion center. Using the same quantizer for all sensors is a widely adopted solution because it simplifies the design problem.
然而,很多传统技术方案主要考虑了在理想无观测噪声存在的环境下,量化器优化的问题。而对考虑观测噪声条件下的量化器设计缺少进一步的研究。此外,很多关于最优量化器的性能分析及理论,都只考虑了二元量化的情况,即传感器上量化数据的长度被限制在1比特。对于传感器上,将观测数据量化成为多比特数据,即量化结果存在多元可能时的情况,相应的量化器设计方案同样缺少研究。However, many traditional technical solutions mainly consider the problem of quantizer optimization in an ideal environment without observation noise. However, there is a lack of further research on quantizer design under the condition of considering observation noise. In addition, many performance analyzes and theories about optimal quantizers only consider the case of binary quantization, that is, the length of quantized data on the sensor is limited to 1 bit. For the sensor, the observation data is quantized into multi-bit data, that is, when the quantization result has multiple possibilities, the corresponding quantizer design scheme is also lack of research.
发明内容Contents of the invention
本发明的目的在于克服现有技术的不足,提供一种基于多元概率量化的分布式信息估计方法,能够适应量化结果存在多元的情况,并保持较高的估计性能。The purpose of the present invention is to overcome the deficiencies of the prior art and provide a distributed information estimation method based on multivariate probability quantization, which can adapt to the situation of multivariate quantification results and maintain high estimation performance.
本发明的目的是通过以下技术方案来实现的:一种基于多元概率量化的分布式信息估计方法,包括以下步骤:The purpose of the present invention is achieved through the following technical solutions: a distributed information estimation method based on multivariate probability quantification, comprising the following steps:
S1.构建分布式信息估计场景:包括一个位于无线通信网络中心的融合中心 FC和多个分布在无线通信网络边缘的传感器;S1. Construct a distributed information estimation scenario: including a fusion center FC located at the center of the wireless communication network and multiple sensors distributed at the edge of the wireless communication network;
每一个传感器都对融合中心需要的原始信息进行观测,并得到自己的本地观测数据,对本地的观测数据进行多元概率量化操作,将连续的观测数据转化为能够被用于数字通信的二进制离散数据,并发送给融合中心FC;FC融合中心根据所有传感器发送过来的量化数据对原始信息进行估计;Each sensor has the raw information required by the fusion center Make observations and get your own local observation data, perform multiple probability quantification operations on the local observation data, convert continuous observation data into binary discrete data that can be used for digital communication, and send it to the fusion center FC; FC fusion center Estimate raw information based on quantitative data sent from all sensors;
S2.构建传感器对本地观测数据进行量化的多元概率量化器;S2. Construct a multivariate probability quantizer for quantifying local observation data by sensors;
S3.优化多元量化概率函数的设计参数;S3. Optimizing the design parameters of the multivariate quantitative probability function ;
S4.融合中心FC设计量化融合估计器并进行优化得到最优估计函数;S4. The fusion center FC designs a quantized fusion estimator and optimizes it to obtain the optimal estimation function ;
S5.基于和的多元概率量化分布式信息估计。S5. Based on with Multivariate Probability Quantification for Distributed Information Estimation.
本发明的有益效果是:本发明的多元量化概率方法在网络的总比特数变化的情况下,仍然保持了随总量化比特数近似线性递减的能力,在分布式无线传感器网络中的高效估计性能。The beneficial effects of the present invention are: the multivariate quantization probability method of the present invention still maintains the ability of approximately linear decrease with the total quantization bit number under the condition that the total number of bits of the network changes, and the efficient estimation in the distributed wireless sensor network performance.
附图说明Description of drawings
图1为本发明的方法流程图;Fig. 1 is method flowchart of the present invention;
图2为分布式信息估计场景示意图;Figure 2 is a schematic diagram of a distributed information estimation scenario;
图3为多元概率量化器结构图;Fig. 3 is a structural diagram of a multivariate probability quantizer;
图4为量化函数结构图;Fig. 4 is a quantization function structural diagram;
图5为量化融合估计器结构图;Fig. 5 is the structural diagram of quantitative fusion estimator;
图6为整个网络总量化比特数变化的情况下,网络对原始信息估计的MSE示意图。Fig. 6 is a schematic diagram of the MSE estimated by the network for the original information when the total number of quantized bits of the entire network changes.
具体实施方式detailed description
下面结合附图进一步详细描述本发明的技术方案,但本发明的保护范围不局限于以下所述。The technical solution of the present invention will be further described in detail below in conjunction with the accompanying drawings, but the protection scope of the present invention is not limited to the following description.
针对未来无线通信网络中基于带宽/能量受限的分布式无线传感器的信息估计问题,本发明设计了一种基于多元概率量化的分布式信息估计方案:包括位于传感器上的多元概率量化器设计及相应的多元量化概率函数优化算法;位于融合中心上的量化融合估计器设计及相应的估计函数优化算法。考虑一个分布式无线传感器网络对一个未知原始信息进行估计的一般化场景,网络包含位于网络中心节点的融合中心(fusion center, FC)和分布于网络边缘的不同位置的多个传感器。原始信息可能是网络需求的任意一类数据,由网络具体的需求决定,如常见的定位信息或者是天气信息等。每一个传感器都对原始信息进行观测,并得到自己的本地观测数据,通常在实际环境中由于环境噪声对观测的影响,本地的观测数据与原始信息间存在误差。对于带宽/能量受限的传感器来说,需要先对本地的观测数据进行量化操作,将连续的观测数据转化能够被用于现代数字通信的二进制离散数据,才能顺利发送自己的观测数据给FC。FC只能使用从所有传感器发送过来的量化数据对原始信息进行估计。原始信息估计性能的衡量指标,一般使用原始信息与其估计值的均方误差(mean squared error, MSE),越小的MSE意味着更精确的估计以及越更好的估计性能;Aiming at the problem of information estimation based on distributed wireless sensors with limited bandwidth/energy in future wireless communication networks, the present invention designs a distributed information estimation scheme based on multivariate probability quantization: including the design of multivariate probability quantizers located on sensors and Corresponding optimization algorithm of multivariate quantization probability function; design of quantization fusion estimator located on fusion center and corresponding estimation function optimization algorithm. Consider a generalized scenario where a distributed wireless sensor network estimates an unknown original information. The network includes a fusion center (FC) located at the central node of the network and multiple sensors distributed at different locations on the edge of the network. The original information may be any type of data required by the network, determined by the specific requirements of the network, such as common positioning information or weather information. Each sensor observes the original information and obtains its own local observation data. Usually, in the actual environment, due to the influence of environmental noise on the observation, there is an error between the local observation data and the original information. For sensors with limited bandwidth/energy, it is necessary to quantify the local observation data first, convert the continuous observation data into binary discrete data that can be used in modern digital communication, and then send their own observation data to FC smoothly. FC can only estimate raw information using quantitative data sent from all sensors. The measurement index of the original information estimation performance generally uses the mean squared error (mean squared error, MSE) of the original information and its estimated value. The smaller the MSE, the more accurate the estimation and the better the estimation performance;
如图1所示,一种基于多元概率量化的分布式信息估计方法,包括以下步骤:As shown in Figure 1, a distributed information estimation method based on multivariate probability quantification includes the following steps:
S1.构建分布式信息估计场景:如图2所示,包括一个位于无线通信网络中心的融合中心 FC和多个分布在无线通信网络边缘的传感器;S1. Build a distributed information estimation scenario: as shown in Figure 2, including a fusion center FC located at the center of the wireless communication network and a plurality of sensors distributed at the edge of the wireless communication network;
每一个传感器都对融合中心需要的原始信息进行观测,并得到自己的本地观测数据,对本地的观测数据进行多元概率量化操作,将连续的观测数据转化为能够被用于数字通信的二进制离散数据,并发送给融合中心FC;FC融合中心根据所有传感器发送过来的量化数据对原始信息进行估计;Each sensor has the raw information required by the fusion center Make observations and get your own local observation data, perform multiple probability quantification operations on the local observation data, convert continuous observation data into binary discrete data that can be used for digital communication, and send it to the fusion center FC; FC fusion center Estimate raw information based on quantitative data sent from all sensors;
S2.构建传感器对本地观测数据进行量化的多元概率量化器:S2. Construct a multivariate probability quantizer for sensor quantification of local observation data:
多个分布在网络边缘的传感器,共同对融合中心需要的原始信息进行观测,分别得到自己的本地观测。这里考虑所有传感器观测时,受环境影响的观测噪声是独立同分布的。因此,为了降低传感器设计及部署时的难度,我们同样考虑所有的传感器上使用完全相同的多元概率量化器结构,包括量化器上任何可调节的设计参数也是相同的。Multiple sensors distributed at the edge of the network jointly collect the original information required by the fusion center Observations are made to get their own local observations respectively. When all sensor observations are considered here, the observation noise affected by the environment is independent and identically distributed. Therefore, in order to reduce the difficulty of sensor design and deployment, we also consider using exactly the same multivariate probability quantizer structure on all sensors, including any adjustable design parameters on the quantizer.
因为考虑了所有传感器上独立同分布的观测噪声,以及使用相同的多元量化器。我们在这里以任意一个传感器(忽略传感器序号)举例,来描述传感器上的观测和数据量化的过程,及多元概率量化器的结构、功能及设计方案。如图3所示,传感器观测原始信息得到本地观测值,用来表示观测值相对于被观测的的条件概率密度函数,以描述它们之间的随机性。传感器得到观测值后将其输入多元概率量化器,并输出最终的量化结果,量化结果是一个包含比特的二进制数据。在量化器的内部,输入的观测值首先被送入一个多元量化概率控制函数,被映射为一个维的概率向量,概率向量中的所有元素都是在区间取值,同时满足相加之和为1,即Because the independent and identically distributed observation noise on all sensors is considered, and the same multivariate quantizer is used. Here we take any sensor (ignoring the serial number of the sensor) as an example to describe the process of observation and data quantification on the sensor, as well as the structure, function and design scheme of the multivariate probability quantizer. As shown in Figure 3, the sensor observes the original information get local observations ,use to represent the observed value compared to the observed The conditional probability density function of , to describe the randomness among them. The sensor gets the observed value Then input it into the multivariate probability quantizer, and output the final quantization result , the quantitative result is a containing bits of binary data. Inside the quantizer, the input observations is first fed into a multivariate quantized probability control function , is mapped to a A probability vector of dimension , the probability vector All elements in the The value of the interval, at the same time, the sum of the addition is 1, that is
(1) (1)
其中,是一个由设计参数控制的可变函数,有in, is a design parameter The variable function of the control has
(2) (2)
其中包含了中所有可调节的参数,是设计参数的个数。从公式(2)中不难看出,通过改变设计参数的取值,相应改变参数函数的函数表达式和结构。从输出的概率向量接着被送入量化函数中(的具体结构在下文及图4中有详细说明),输出一个十进制的一维离散值,接着我们通过将十进制的转化为二进制的量化结果。对于量化函数,它的输出一共有不同的结果,期望是使得取每一种结果的概率完全由维的概率向量控制,即实现in contains All adjustable parameters in is the number of design parameters. It is not difficult to see from formula (2) that by changing the design parameters value, change the parameter function accordingly function expressions and structures. from output probability vector is then fed into the quantization function middle( The specific structure is described in detail below and in Figure 4), outputting a decimal one-dimensional discrete value , then we pass the decimal Quantized results converted to binary . For the quantization function , which outputs A total of different results, the expectation is that the The probability of taking each outcome is entirely determined by A probability vector of dimension to control, to achieve
(3) (3)
其中表示在给定输入多元概率量化器的观测值的前提下,量化输出取值为的概率。in represents the observations at the given input multivariate probability quantizer Under the premise that the quantized output The value is The probability.
为了实现上述描述的多元概率量化器对本地观测数据进行概率量化的功能,我们对多元概率量化器中的量化函数设计如图4所示的结构。In order to realize the function of the multivariate probability quantizer described above to quantify the probability of local observation data, we quantify the quantization function in the multivariate probability quantizer Design the structure shown in Figure 4.
其中量化函数的输入是维的概率向量,输出是一维离散值,它由个串行的具有相同结构的子层组成,具体的结构功能如下:where the quantization function The input is A probability vector of dimension , the output is a one-dimensional discrete value , which consists of It consists of a series of sub-layers with the same structure, and the specific structural functions are as follows:
输入:输入维的概率向量,及初始的量化值。input: input A probability vector of dimension , and the initial quantization value .
第m子层,m=1,2,…,M: 第m子层的输入(如果m=1,其输入是和)是上一个子层(第m-1子层)输出的维的向量和量化值;首先,在第m子层中,将输入的分为两个相同长度的子向量,分别包含前半段的所有元素和后半段的所有元素,即两个维的子向量和;接着,第m子层利用和输出量化值,其中The mth sublayer, m=1,2,...,M: The input of the mth sublayer (if m=1, its input is with ) is the output of the previous sublayer (m-1th sublayer) vector of dimensions and quantized value ; First, in the mth sublayer, the input Divide into two sub-vectors of the same length, containing All elements of the first half and all elements of the second half, i.e. two Dimension subvector with ; Next, the mth sublayer uses with output quantized value ,in
(4) (4)
是[0,1]区间均匀分布的随机噪声,函数输入非负数会输出1,反之输入负数会输出0。定义,第m子层输出维的向量,其中 is random noise uniformly distributed in the [0,1] interval, the function Inputting a non-negative number will
(5) (5)
输出:量化函数的输出量化值即为其第子层输出的量化值,即。output: quantization function The output quantization value of is its first Quantized value of sublayer output ,Right now .
通过如图4的结构,量化函数实现了使其输出的量化值取其每一种可能结果的概率完全由概率向量来控制,实现了公式(3)中的功能。Through the structure shown in Figure 4, the quantization function implements the quantized value that makes it output The probability of each possible outcome is completely determined by the probability vector To control, realize the function in the formula (3).
S3.优化多元量化概率函数的设计参数;S3. Optimizing the design parameters of the multivariate quantitative probability function ;
如公式(2)和(3)中所示,通过调节传感器上的多元概率量化器中多元量化概率控制函数的设计参数的取值,我们可以相应地改变的函数表达式,进而改变传感器上的量化数据相对于本地观测数据及原始信息的概率分布。这意味着针对服从不同随机分布的原始信息,和不同观测环境下的具有不同随机特性的观测噪声,我们可以通过优化多元量化概率函数的设计参数,以获得适应当前环境的最优量化数据概率分布。通过利用贝叶斯估计理论,我们考虑通过算法最小化由决定的,传感器对本地观测进行量化后,在融合中心使用量化后的数据能达到的估计的MSE下界,以找到适应当前观测环境下的最优设计参数,及传感器上对应的使用最优设计参数的最优多元量化概率函数。As shown in equations (2) and (3), by adjusting the multivariate quantization probability control function in the multivariate probability quantizer on the sensor design parameters value, we can change accordingly The function expression of the sensor can change the probability distribution of the quantitative data on the sensor relative to the local observation data and original information. This means that for the original information subject to different random distributions, and the observation noise with different random characteristics under different observation environments, we can optimize the multivariate quantization probability function design parameters , to obtain the optimal quantitative data probability distribution suitable for the current environment. By utilizing Bayesian estimation theory, we consider algorithmically minimizing by Determined, after the sensor quantifies the local observations, the estimated MSE lower bound can be achieved using the quantified data in the fusion center to find the optimal design parameters for the current observation environment , and the corresponding optimal design parameters on the sensor The optimal multivariate quantified probability function for .
我们假设一共有个独立的传感器分布在整个网络中,所有传感器上都使用如图3所示的多元概率量化器结构,并且我们在所有的多元概率量化器中使用完全相同的多元量化概率函数和相应的设计参数,以降低整个网络的设计成本和难度。个传感器分别对原始信息进行观测,分别得到自己的带有观测噪声的本地观测数据。我们这里考虑各个传感器上存在独立同分布的观测噪声,并定义概率密度函数来描述观测噪声的分布:对于第个传感器,它的本地观测数据经过本地的多元概率量化器,被量化成比特的二进制数据,并被发送给网络中心的FC。所以个传感器一共产生了个比特的量化数据并发送给了FC,FC需要利用所有接收到的量化数据来对原始信息进行估计。We assume that there are independent sensors are distributed throughout the network, all sensors use the multivariate probability quantizer structure shown in Figure 3, and we use exactly the same multivariate quantization probability function in all multivariate probability quantizers and the corresponding design parameters , to reduce the design cost and difficulty of the entire network. sensor to the original information Make observations to obtain their own local observation data with observation noise . Here we consider that there is independent and identically distributed observation noise on each sensor, and define the probability density function to describe the distribution of observation noise: for the first sensor, its local observation data After the local multivariate probability quantizer, it is quantized as bit of binary data , and sent to the FC in the network center. so sensors produced a total of indivual quantized data in bits And sent to FC, FC needs to use all the quantized data received to estimate the original information.
通过贝叶斯概率理论,所有传感器上的量化数据在给定的情况下也是独立同分布的。因此,基于量化数据的概率分布,首先计算当FC接收到量化数据时,对原始信息进行估计所能达到的估计MSE的下界,即Through Bayesian probability theory, the quantitative data on all sensors are in a given is also independent and identically distributed. Therefore, based on the probability distribution of quantized data, first calculate when FC receives quantized data , for the original information The lower bound of the estimated MSE that can be achieved by performing the estimation, that is,
(6) (6)
其中,表示FC接收到的所有从传感器发送过来的量化数据,表示FC利用量化数据所能实现的对的任意估计值,相应地公式中不等式左边的表示原始信息和其估计值之间的MSE,表示求取数学期望的操作,公式(6)中不等式右边表示求取的MSE下界,是数学定义中的组合数,in , Indicates all the quantitative data sent from the sensor received by the FC, Indicates that FC utilizes quantified data what can be achieved Any estimated value of , corresponding to the left side of the inequality in the formula Indicates the original information and its estimated value MSE between, Indicates the operation of obtaining the mathematical expectation, and the right side of the inequality in formula (6) represents the lower bound of the obtained MSE, is the combination number in the mathematical definition,
(7) (7)
是由多元量化概率函数的设计参数和原始信息决定的一系列中间计算项。从公式(6)中可以看出,在原始信息的概率分布和观测噪声分布都确定的情况下,FC利用量化数据对进行估计的MSE,即,其下界完全由多元量化概率函数的设计参数决定。因此,通过算法最小化公式(6)中不等式右边,由决定的FC使用量化数据对原始信息估计的MSE的下界,以找到适应当前观测环境下的最优设计参数,及对应的最优多元量化概率函数。is a multivariate quantified probability function design parameters and original information A sequence of intermediate calculation terms for a decision. It can be seen from formula (6) that in the original information The probability distribution and the observation noise distribution of When both are determined, FC uses quantized data to Estimated MSE, ie , whose lower bound is entirely given by the multivariate quantized probability function design parameters Decide. Therefore, by algorithmically minimizing the right side of the inequality in formula (6), by The determined FC uses quantitative data to estimate the lower bound of the MSE of the original information to find the optimal design parameters for the current observation environment , and the corresponding optimal multivariate quantified probability function .
基于上述分析,我们考虑如下的一种迭代算法,基于从实际观测环境收集到的原始信息与传感器本地观测数据的一系列样本,在算法的每次迭代中近似求解关于设计参数的优化问题,并在迭代过程中逐渐逼近最优的设计参数。Based on the above analysis, we consider an iterative algorithm as follows, based on a series of samples of the original information collected from the actual observation environment and the local observation data of the sensor, the optimization problem about the design parameters is approximately solved in each iteration of the algorithm, and Gradually approach the optimal design parameters in the iterative process .
初始化:传感器总数为,样本集, 为样本集包含的总样本数,是原始信息样本,表示样本的序号,而表示传感器对原始信息样本总共观测次得到的个观测样本;设定初始的设计参数,将迭代的容忍门限设定为,设定初始的迭代计数为。Initialization: The total number of sensors is , sample set , is the total number of samples contained in the sample set, is the original information sample, represents the serial number of the sample, and Represents the sensor’s response to raw information samples total observations times obtained observation samples; set the initial design parameters , set the tolerance threshold of the iteration as , set the initial iteration count as .
步骤一:在第次迭代中,按照公式(7)对的定义,对,计算由第次迭代中得到的多元量化概率函数设计参数决定的一系列中间计算项,其中Step 1: In the In iterations, according to formula (7) for definition of , calculated by the The multivariate quantitative probability function design parameters obtained in the second iteration A series of intermediate calculation items determined ,in
(8) (8)
步骤二:利用公式(8)中的和样本集,将式(6)中不等式右边的MSE下界近似计算为Step 2: Using the formula (8) and sample set , the MSE lower bound on the right side of the inequality in equation (6) is approximately calculated as
(9) (9)
然后利用内点法和梯度下降法,解决如下最小化问题Then use the interior point method and gradient descent method to solve the following minimization problem
(10) (10)
求解之后得到新的设计参数。After solving, the new design parameters are obtained .
步骤三:计算并查看收敛条件是否成立。Step 3: Calculate and view the convergence conditions Whether it is established.
如果不成立,说明需要继续迭代,需要将带入步骤A2进行下一次迭代,并更新迭代计数;如果收敛条件成立,则输出作为最优的设计参数。If it is not established, it means that the iteration needs to be continued, and the Bring into step A2 for the next iteration and update the iteration count ; if the convergence condition holds, the output as an optimal design parameter.
输出:最优设计参数 Output: optimal design parameters
通过以上算法可以得到最优的设计参数,及相对应的对最优多元量化概率函数。The optimal design parameters can be obtained by the above algorithm , and the corresponding probability function for optimal multivariate quantization .
S4.融合中心FC设计量化融合估计器并进行优化得到最优估计函数;S4. The fusion center FC designs a quantized fusion estimator and optimizes it to obtain the optimal estimation function ;
如上文中提到,个传感器一共产生了个比特的并发送给了FC,FC需要利用所有接收到的量化数据来对原始信息进行估计。因此,我们首先给出FC上的量化融合估计器设计。As mentioned above, sensors produced a total of indivual bit And sent to FC, FC needs to use all the quantized data received to estimate the original information. Therefore, we first present a quantized fusion estimator design on FC.
如图5所示,FC接收到从个传感器发送过来的个量化数据,并将其输入量化融合估计器,输出对原始信息的估计值。在量化融合估计器中,输入的个比特的二进制量化数据首先被转化为相应的个在中取值十进制离散数据;As shown in Figure 5, the FC receives the slave sent by a sensor quantitative data , and input it into the quantized fusion estimator, and output the original information estimated value of . In the quantized fusion estimator, the input indivual Binary Quantized Data in Bits is first transformed into the corresponding one in Median decimal discrete data ;
个十进制数据接着被送入Onehot函数进行独热编码操作,得到相应的个独热编码向量。以第个十进制数据举例,是它的对应的独热编码向量,为bit长度的二进制数据,给中的总共位bit按顺序编号为位,十进制数据的取值范围刚好是所有bit的序号,独热编码意味着只有中的第位bit会被取值为1,剩下的其余所有位bit都会取值为0,即, decimal data Then it is sent to the Onehot function for one-hot encoding operation, and the corresponding one-hot encoded vector . to the first decimal data For example, is its corresponding one-hot encoded vector, for bit-length binary data, given in total The bits are numbered sequentially as bit, decimal data The value range of is exactly the serial number of all bits, and one-hot encoding means that only in the first The bit bit will take the
(11) (11)
接着,个独热编码向量被送入平均器,得到它们的均值向量;then, one-hot encoded vector are fed into the averager to get their mean vector ;
之后再被送入估计函数中,输出对原始信息的估计值,,同样是一个设计参数控制的函数,即after is then fed into the estimation function , output an estimate of the original information , , is also a design parameter control function, that is
(12) (12)
其中包含了中所有的可调节参数。in contains All adjustable parameters in .
当所有传感器上使用相同的如图3所示的多元概率量化器,以及使用带有相同的最优设计参数的多元量化概率函数,则所有传感器发送给FC的量化数据相对于原始信息是条件独立同分布的;When using the same multivariate probability quantizer as shown in Figure 3 on all sensors, and using the same optimal design parameters The multivariate quantified probability function of , then the quantitative data sent by all sensors to FC is relative to the original information is conditionally independent and identically distributed;
此时基于贝叶斯估计理论和概率模型,计算出FC对原始信息的估计值与原始信息间的MSE为At this time, based on Bayesian estimation theory and probability model, the estimated value of FC to the original information is calculated with original information The MSE between
(13) (13)
为估计MSE, To estimate the MSE,
(14) (14)
遵循公式(7)中对的定义,由多元量化概率函数的最优设计参数和原始信息决定的一系列中间计算项;Follow formula (7) for The definition of , by the optimal design parameters of the multivariate quantified probability function and original information A series of intermediate calculation items determined;
由公式(13)得到,在多元量化概率函数的最优设计参数确定的情况下,FC上对原始信息估计的MSE完全由估计函数的可变设计参数控制;Obtained by formula (13), the optimal design parameters of the multivariate quantitative probability function Under certain circumstances, the MSE estimated on the original information on FC is completely determined by the estimation function The variable design parameters of control;
S404.基于从实际观测环境收集到的原始信息与传感器本地观测数据的一系列样本,以及传感器上最优的多元量化概率函数,求解使得FC上估计MSE最小的最优估计函数设计参数。S404. A series of samples based on the original information collected from the actual observation environment and the local observation data of the sensor, and the optimal multivariate quantitative probability function on the sensor , to find the optimal estimator function design parameters that minimize the estimated MSE on FC .
初始化:输入传感器总数,传感器上最优的多元量化概率函数和其相应的最优设计参数,样本集,遵循公式(14)中对的定义,对任意的,将由和原始信息样本决定的中间项近似计算为Initialization: Enter the total number of sensors , the optimal multivariate quantized probability function on the sensor and its corresponding optimal design parameters , sample set , following formula (14) for definition, for any , will be given by and a sample of the original information middle term of decision Approximately calculated as
(15) (15)
设定初始的设计参数,将迭代的容忍门限设定为,设定初始的迭代计数为。Set initial design parameters , set the tolerance threshold of the iteration as , set the initial iteration count as .
步骤一:在第次迭代中,定义为FC上估计的MSE,利用公式(13),和第次迭代中得到的设计参数,将近似计算为Step 1: In the In iterations, define is the estimated MSE on FC, using formula (13), and the design parameters obtained in the first iteration ,Will Approximately calculated as
(16) (16)
利用内点法和梯度下降法,解决如下最小化问题Using the interior point method and gradient descent method, the following minimization problem is solved
(17) (17)
得到新的设计参数。get new design parameters .
步骤二:计算并查看收敛条件是否成立;如果不成立,继续迭代,将带入步骤B2进行下一次迭代,并更新迭代计数;如果收敛条件成立,则输出作为最优的设计参数。Step 2: Calculate and view the convergence conditions Whether it is established; if not, continue to iterate, and will Bring into step B2 for the next iteration and update the iteration count ; if the convergence condition holds, the output as an optimal design parameter.
输出:最优设计参数。Output: optimal design parameters .
通过以上算法可以得到最优的设计参数,及相对应的最优估计函数。The optimal design parameters can be obtained by the above algorithm , and the corresponding optimal estimation function .
S5.基于和的多元概率量化分布式信息估计。S5. Based on with Multivariate Probability Quantification for Distributed Information Estimation.
基于上文的两个算法,我们分别得到了所有传感器上的最优多元量化概率函数和FC上的最优估计函数。接下来我们再简要描述一下整个网络对原始信息估计的全过程。其中关于传感器上的多元概率量化器和FC上的量化融合估计器,它们的功能结构在上文中已有详细描述,这里不再赘述。Based on the above two algorithms, we obtained the optimal multivariate quantization probability function on all sensors respectively and the optimal estimation function on FC . Next, we briefly describe the whole process of the entire network to estimate the original information. Regarding the multivariate probability quantizer on the sensor and the quantization fusion estimator on the FC, their functional structures have been described in detail above, and will not be repeated here.
首先,个传感器对原始信息分别进行观测。以第个传感器举例,它对观测后得到自己的本地观测数据,并将送入如图3所示的多元概率量化器中(注意此时,图3中的多元量化概率函数已经被最优的替代),最后输出bit的二进制量化数据被发送给FC。所有个传感器一共产生了个量化数据。FC收到来自所有传感器的个量化数据,并将它们送入如图5所示的量化融合估计器中(同样注意此时,图5中的估计函数已经被最优的替代),最后输出原始信息的估计值。first, raw information observed separately. to the first For example, a sensor that is Get your own local observation data after observation , and will into the multivariate probability quantizer shown in Figure 3 (note that at this point, the multivariate quantization probability function in Figure 3 has been optimized alternative), and finally output binary quantized data of bit is sent to FC. all sensors produced a total of quantitative data . FC receives from all sensors Quantized data, and send them to the quantized fusion estimator shown in Figure 5 (also note that at this time, the estimation function in Figure 5 has been optimized alternative), and finally output the estimated value of the original information .
在本申请的实施例中,考察所提出的基于多元概率量化的分布式信息估计方法在实际环境中对原始信息的估计性能,如前文所述我们在这里使用原始信息与其估计值的均方误差(MSE)作为评估准则,MSE越小表示估计性能越好。特别地,我们实验了当整个网络的总量化比特数变化的时候,网络对原始信息估计的MSE性能,并将其与目前最优的二元量化SQMLF方法和在二元量化(一比特量化)下对原始信息估计能达到的理论最小MSE下界进行比较。从图6可以看出,尽管使用二元量化的限定下,SQMLF方法已经几乎在任何时候都完全逼近对原始信息估计的MSE下界,但使用多元概率量化方法的分布式无线传感器网络对原始信息的估计MSE要远小于这两者,这意味着在不考虑对传感器上量化数据的比特数进行限制的情况下,我们提出的多元概率量化方法要优于任何一种二元量化的方法。此外,可以观察到,多元量化概率方法在网络的总比特数变化的情况下,仍然保持了随总量化比特数近似线性递减的能力。这验证了我们所提出的多元概率量化方法在分布式无线传感器网络中的高效估计性能,以及对实际环境中网络的总量化比特数动态变化的适应性和拓展性。In the embodiment of this application, we examine the estimation performance of the proposed distributed information estimation method based on multivariate probability quantification on the original information in the actual environment. As mentioned above, we use the mean square error of the original information and its estimated value here (MSE) is used as an evaluation criterion, and the smaller the MSE, the better the estimation performance. In particular, we experimented with the MSE performance of the network's estimated raw information when the total number of quantization bits of the entire network varies, and compared it with the current optimal binary quantization SQMLF method and in binary quantization (one-bit quantization ) to compare the theoretical minimum MSE lower bound that the original information estimate can achieve. It can be seen from Figure 6 that although the SQMLF method has almost completely approached the MSE lower bound of the original information estimation under the limitation of binary quantization, the distributed wireless sensor network using the multivariate probability quantization method does not The estimated MSE is much smaller than the two, which means that the proposed multivariate probability quantization method is better than any binary quantization method without considering the limitation on the number of bits of quantized data on the sensor. In addition, it can be observed that the multivariate quantization probability method still maintains the ability to approximately linearly decrease with the total number of quantized bits when the total number of bits in the network changes. This verifies the efficient estimation performance of our proposed multivariate probability quantization method in distributed wireless sensor networks, as well as its adaptability and scalability to the dynamic change of the total quantization bit number of the network in the actual environment.
上述说明示出并描述了本发明的一个优选实施例,但如前所述,应当理解本发明并非局限于本文所披露的形式,不应看作是对其他实施例的排除,而可用于各种其他组合、修改和环境,并能够在本文所述发明构想范围内,通过上述教导或相关领域的技术或知识进行改动。而本领域人员所进行的改动和变化不脱离本发明的精神和范围,则都应在本发明所附权利要求的保护范围内。The above description shows and describes a preferred embodiment of the present invention, but as mentioned above, it should be understood that the present invention is not limited to the form disclosed herein, and should not be regarded as excluding other embodiments, but can be used in various Various other combinations, modifications, and environments can be made within the scope of the inventive concept described herein, by the above teachings or by skill or knowledge in the relevant field. However, changes and changes made by those skilled in the art do not depart from the spirit and scope of the present invention, and should all be within the protection scope of the appended claims of the present invention.
Claims (9)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202211229494.1A CN115290130B (en) | 2022-10-08 | 2022-10-08 | Distributed information estimation method based on multivariate probability quantization |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202211229494.1A CN115290130B (en) | 2022-10-08 | 2022-10-08 | Distributed information estimation method based on multivariate probability quantization |
Publications (2)
Publication Number | Publication Date |
---|---|
CN115290130A CN115290130A (en) | 2022-11-04 |
CN115290130B true CN115290130B (en) | 2022-12-16 |
Family
ID=83819224
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202211229494.1A Active CN115290130B (en) | 2022-10-08 | 2022-10-08 | Distributed information estimation method based on multivariate probability quantization |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN115290130B (en) |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8886526B2 (en) * | 2012-05-04 | 2014-11-11 | Sony Computer Entertainment Inc. | Source separation using independent component analysis with mixed multi-variate probability density function |
CN107451101B (en) * | 2017-07-21 | 2020-06-09 | 江南大学 | A Hierarchical Integrated Gaussian Process Regression Soft Sensing Modeling Method for Predicting Butane Concentration in Debutanizer Bottoms |
CN110035405B (en) * | 2019-04-18 | 2020-04-28 | 电子科技大学 | A Distributed and Efficient Fusion Method of Multi-sensor Based on Random Set Theory |
CN114235257A (en) * | 2021-12-24 | 2022-03-25 | 长春工业大学 | Bolt axial force online accurate monitoring method and device based on data fusion |
CN114900817B (en) * | 2022-07-12 | 2022-09-30 | 香港中文大学(深圳) | An Information Estimation Method for Distributed Wireless Sensor Networks Based on Binary Quantization |
-
2022
- 2022-10-08 CN CN202211229494.1A patent/CN115290130B/en active Active
Also Published As
Publication number | Publication date |
---|---|
CN115290130A (en) | 2022-11-04 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Shlezinger et al. | Federated learning with quantization constraints | |
CN109462520B (en) | Network traffic resource situation prediction method based on LSTM model | |
CN112817653A (en) | Cloud-side-based federated learning calculation unloading computing system and method | |
Luo | An isotropic universal decentralized estimation scheme for a bandwidth constrained ad hoc sensor network | |
CN110912598A (en) | CSI feedback method for massive MIMO system based on long and short-term attention mechanism | |
CN113222179A (en) | Federal learning model compression method based on model sparsification and weight quantization | |
Chen et al. | Compressive network coding for wireless sensor networks: Spatio-temporal coding and optimization design | |
Kim et al. | On the tradeoff between energy, precision, and accuracy in federated quantized neural networks | |
CN113381952A (en) | Multi-antenna system channel estimation method based on deep learning | |
Gupta et al. | SBL-based adaptive sensing framework for WSN-assisted IoT applications | |
KR102554676B1 (en) | Bayesian federated learning driving method over wireless networks and the system thereof | |
Chen et al. | Communication-efficient design for quantized decentralized federated learning | |
CN107317583A (en) | Variable step size distributed compression based on Recognition with Recurrent Neural Network perceives method for reconstructing | |
Li et al. | FedGreen: Federated learning with fine-grained gradient compression for green mobile edge computing | |
Zhang et al. | Fundamental limits of communication efficiency for model aggregation in distributed learning: A rate-distortion approach | |
Al-Qurabat et al. | Dictionary-based dpcm method for compressing iot big data | |
CN115290130B (en) | Distributed information estimation method based on multivariate probability quantization | |
Chen et al. | DNN gradient lossless compression: Can GenNorm be the answer? | |
Chen et al. | Linear convergent distributed Nash equilibrium seeking with compression | |
CN106453167A (en) | Method and device for building codebook, and method and device for building precoding matrix | |
Khalilian et al. | Fedcode: Communication-efficient federated learning via transferring codebooks | |
CN114900817B (en) | An Information Estimation Method for Distributed Wireless Sensor Networks Based on Binary Quantization | |
Zheng et al. | Deep reinforcement learning-based quantization for federated learning | |
CN117216596A (en) | Federal learning optimization communication method, system and storage medium based on gradient clustering | |
Han et al. | A data gathering algorithm based on compressive sensing in lossy wireless sensor networks |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |