CN108629125A - Subspace projection filter design based on rejecting outliers - Google Patents
Subspace projection filter design based on rejecting outliers Download PDFInfo
- Publication number
- CN108629125A CN108629125A CN201810435822.0A CN201810435822A CN108629125A CN 108629125 A CN108629125 A CN 108629125A CN 201810435822 A CN201810435822 A CN 201810435822A CN 108629125 A CN108629125 A CN 108629125A
- Authority
- CN
- China
- Prior art keywords
- interference
- subspace
- sample
- signal
- noise
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F30/00—Computer-aided design [CAD]
- G06F30/20—Design optimisation, verification or simulation
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
- G06F17/10—Complex mathematical operations
- G06F17/16—Matrix or vector computation, e.g. matrix-matrix or matrix-vector multiplication, matrix factorization
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Mathematical Physics (AREA)
- Computational Mathematics (AREA)
- Mathematical Optimization (AREA)
- Data Mining & Analysis (AREA)
- Pure & Applied Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Mathematical Analysis (AREA)
- Computing Systems (AREA)
- Computer Hardware Design (AREA)
- Evolutionary Computation (AREA)
- Algebra (AREA)
- Geometry (AREA)
- Databases & Information Systems (AREA)
- Software Systems (AREA)
- Measurement Of Mechanical Vibrations Or Ultrasonic Waves (AREA)
Abstract
Description
技术领域technical field
本发明涉及通信领域中自适应干扰信号抑制处理,具体涉及特征值检测的子空间投影干扰抑制方法,即对样本协方差进行特征分解,利用干扰和信号及噪声特性的不同,设计自适应检测干扰特征值方法,抑制干扰。The present invention relates to adaptive interference signal suppression processing in the field of communication, in particular to a subspace projection interference suppression method for eigenvalue detection, that is, to perform eigendecomposition on sample covariance, and to design an adaptive detection interference by using the difference in interference and signal and noise characteristics Eigenvalue method to suppress interference.
背景技术Background technique
子空间投影设计的滤波器,可以消除干扰子空间,降低干扰影响。但是在子空间投影方法中,对于干扰子空间对应的特征值个数要求有准确的判断,如果判断的特征值个数少于实际个数,那么干扰抑制不彻底,残余的干扰分量会继续恶化通信性能。相反,如果判断的特征值个数大于实际个数,那么有用信号会受到损害,降低了信噪比和通信性能。因此,有必要对干扰子空间的特征值进行分析,对特征值进行分类,从而给出自适应的子空间判断方法,识别出干扰特征值。一般文献认为,干扰特征值具有“远远大于”信号和噪声特征值,从而忽略了细致的讨论,而是采用一种粗糙的办法,典型的有“大于最大特征值百分之几(阈值)的部分特征值为干扰特征值”。传统方法对干扰幅度差别进行干扰特征值检测的办法,不利于对幅度差别较大的干扰特征值进行成功的检测。即在实际应用时,对应不同子空间的特征值幅度本身相差较大,过大的干扰特征值会使得较小的干扰特征值位于阈值之下而被误认为是信号或噪声子空间。The filter designed by subspace projection can eliminate the interference subspace and reduce the influence of interference. However, in the subspace projection method, an accurate judgment is required for the number of eigenvalues corresponding to the interference subspace. If the number of eigenvalues judged is less than the actual number, the interference suppression will not be complete, and the residual interference components will continue to deteriorate. communication performance. On the contrary, if the number of judged eigenvalues is greater than the actual number, the useful signal will be damaged, reducing the signal-to-noise ratio and communication performance. Therefore, it is necessary to analyze the eigenvalues of the interference subspace and classify the eigenvalues, so as to provide an adaptive subspace judgment method and identify the interference eigenvalues. The general literature believes that the interference eigenvalue is "much larger" than the signal and noise eigenvalues, thus ignoring the detailed discussion, but adopting a rough method, typically "a few percent (threshold) greater than the maximum eigenvalue" Some of the eigenvalues are interference eigenvalues". The traditional method of detecting interference eigenvalues based on the difference in interference amplitude is not conducive to successful detection of interference eigenvalues with large amplitude differences. That is, in practical applications, the eigenvalue amplitudes corresponding to different subspaces are quite different, and too large interference eigenvalues will make smaller interference eigenvalues below the threshold and be mistaken for signal or noise subspaces.
针对以上问题,本发明提出一种基于异常值检测的子空间投影滤波器。即基于白噪声的特性及参数进行干扰特征值检测,与白噪声特征值的差距大于标准差一定的倍数,被认为是“异常值”即干扰特征值,消除了干扰特征值本身大小差距的影响,结合子空间投影方法抑制干扰。In view of the above problems, the present invention proposes a subspace projection filter based on outlier detection. That is, based on the characteristics and parameters of white noise, the interference eigenvalue detection is performed. The difference between the eigenvalue and the white noise eigenvalue is greater than a certain multiple of the standard deviation. , combined with the subspace projection method to suppress interference.
发明内容Contents of the invention
本发明提出对样本协方差矩阵进行特征分析,是否符合高斯分布检验异常值的方法,以及利用检验统计量的方法,自适应求出干扰和信号之间特征值的阈值,检测干扰异常值,最后根据不同信号对应的特征子空间的正交性,实现样本数据映射到非干扰子空间中,从而抑制干扰。The present invention proposes a method for analyzing the characteristics of the sample covariance matrix, checking whether it conforms to the Gaussian distribution, and using the method of test statistics to adaptively obtain the threshold value of the characteristic value between the interference and the signal, and detect the interference abnormal value, and finally According to the orthogonality of the characteristic subspaces corresponding to different signals, the sample data is mapped to the non-interference subspace, thereby suppressing interference.
为达到以上技术目的,本发明采用如下技术方案予以实现。In order to achieve the above technical objectives, the present invention adopts the following technical solutions to achieve.
一种基于异常值检测的子空间投影滤波器设计方法,包括以下步骤:A subspace projection filter design method based on outlier detection, comprising the following steps:
步骤1,对接受的信号计算其自相关函数,排列为自相关矩阵;Step 1, calculate the autocorrelation function of the received signal and arrange it as an autocorrelation matrix;
步骤2,对估计的协方差矩阵进行特征值分解,得到特征值矩阵;Step 2, performing eigenvalue decomposition on the estimated covariance matrix to obtain the eigenvalue matrix;
步骤3,对特征值矩阵特征值元素取绝对值,并从小到大排列为次序统计量X,视为观测数据样本使用Lilliefors检验统计量的检测算法,求出干扰特征值的自适应阈值;Step 3, take the absolute value of the eigenvalue elements of the eigenvalue matrix, and arrange them from small to large as the order statistic X, and use the detection algorithm of the Lilliefors test statistic as the observation data sample to find the adaptive threshold of the interference eigenvalue;
步骤4,根据求得的自适应阈值,检测干扰特征值集合Σi后,确定其子空间Ui,则信号与噪声子空间为Ui的补集,进行子空间投影抑制干扰。Step 4: After detecting the interference feature value set Σ i according to the obtained adaptive threshold, determine its subspace U i , then the signal and noise subspaces are the complement of U i , and perform subspace projection to suppress interference.
本发明与现有的技术相比具有以下优点:Compared with the prior art, the present invention has the following advantages:
第一,本发明根据干扰特征值具有“远远大于”信号和噪声特征值的特点,对待检验数据次序统计量X从小到大逐个引入样本,进行多次检验,计算对应的检验统计量排列为向量D。当干扰被计入时,统计量D突然急剧增大。待检验数据X中符合样本个数,可认为是统计量D随检验数据量变化最小值所对应样本序号,即该样本序号所对应样本幅度,可认为是阈值。高于该阈值者为异常值。避免不同子空间的特征值幅度本身相差较大,过大的干扰特征值会使得较小的干扰特征值位于阈值之下而被误认为是信号或噪声子空间的问题。First, according to the characteristic that the interference characteristic value is "far greater" than the signal and noise characteristic value, the order statistic X of the data to be tested is introduced into samples one by one from small to large, and multiple inspections are carried out, and the corresponding test statistics are calculated and arranged as vector D. When disturbances are taken into account, the statistic D suddenly increases dramatically. The number of conforming samples in the data X to be tested can be considered as the sample number corresponding to the minimum value of the statistic D changing with the amount of test data, that is, the sample range corresponding to the sample number can be considered as the threshold. Those above this threshold are outliers. Avoid the large difference in the magnitude of the eigenvalues of different subspaces. Too large interference eigenvalues will make smaller interference eigenvalues below the threshold and be mistaken for signal or noise subspaces.
第二,本发明采用自适应检测干扰特征值,自适应求出干扰特征值阈值,克服了对干扰子空间个数判断不明的问题,使通信性能的损害降到最低,提高了滤波器的性能。Second, the present invention adopts adaptive detection of interference eigenvalues, adaptively obtains the threshold of interference eigenvalues, overcomes the problem of unclear judgment on the number of interference subspaces, minimizes the damage of communication performance, and improves the performance of the filter .
附图说明Description of drawings
图1为本发明异常值检测的子空间投影滤波器仿真方法流程图。FIG. 1 is a flow chart of the subspace projection filter simulation method for outlier detection in the present invention.
图2为本发明异常值检测求取自适应阈值的流程图。Fig. 2 is a flow chart of obtaining an adaptive threshold for outlier detection in the present invention.
图3为干扰和信号的特征值分布图。Fig. 3 is the eigenvalue distribution diagram of interference and signal.
图4为Lilliefors检验统计量随次序统计量的变化图。Figure 4 is a graph showing the variation of Lilliefors test statistic with order statistic.
图5为分别通过本发明滤波器和传统滤波器检测的误码率性能曲线图。Fig. 5 is a graph showing bit error rate performance curves detected by the filter of the present invention and the conventional filter respectively.
具体实施方式Detailed ways
以下结合附图和实施方法对本发明进一步说明。The present invention will be further described below in conjunction with the accompanying drawings and implementation methods.
参照图1,本发明基于异常值检测的子空间投影滤波器仿真方法,包括以下步骤:对接受信号求自相关矩阵、自适应求出干扰特征值阈值、确定非干扰子空间、子空间投影抑制干扰。With reference to Fig. 1, the subspace projection filter simulation method based on outlier detection of the present invention comprises the following steps: obtain the autocorrelation matrix for the received signal, adaptively obtain the interference eigenvalue threshold, determine the non-interference subspace, subspace projection suppression interference.
首先对样本数据进行自相关矩阵求解,即Firstly, the autocorrelation matrix is solved for the sample data, that is,
然后对自相关矩阵进行特征值分解,假设特征值分解为Then perform eigenvalue decomposition on the autocorrelation matrix, assuming that the eigenvalue decomposition is
其中下标i,s,n分别代表干扰、信号、白噪声。The subscripts i, s, and n represent interference, signal, and white noise, respectively.
图2表示基于Lilliefors检验统计量的检测算法的流程,采用统计检验的思想,利用次序统计量进行依次计算。对分解后的特征值从小到大排列为次序统计量X,视为观测数据样本。设观测数据样本个数(维度)为L。设置最小的噪声样本数l0。步骤2包括以下步骤:Figure 2 shows the flow of the detection algorithm based on the Lilliefors test statistic, which adopts the idea of statistical testing and uses order statistics to perform sequential calculations. Arrange the decomposed eigenvalues from small to large as an order statistic X, which is regarded as an observation data sample. Let the number of observation data samples (dimension) be L. Set the minimum number of noise samples l 0 . Step 2 includes the following steps:
第2-1步:给以l=l0,...,L,取X的前l个数据为检验向量Xl。计算样本的均值和标准差参数Step 2-1: Given l=l 0 ,...,L, take the first l data of X as the test vector X l . Compute the sample mean and standard deviation parameters
第2-2步:计算高斯分布的期望累计分布函数Step 2-2: Calculate the expected cumulative distribution function of the Gaussian distribution
第2-3步:计算样本累计分布函数Step 2-3: Calculate the sample cumulative distribution function
第2-4步:计算统计量D的第l个元素,为Step 2-4: Calculate the lth element of the statistic D, which is
第2-5步:寻找统计量D最小值,给出其对应的样本点数Step 2-5: Find the minimum value of the statistic D and give its corresponding sample points
对于l<Ln的X(l)为噪声样本,l>Ln的X(l)为干扰样本,得到噪声方差估计为σn,此时噪声样本比例为η=Ln/L。其中l0设置的合理范围较为宽松,例如l0/L=0.5即可满足要求,这是因为一般来说干扰特征值不会过多。For X(l) where l<L n is a noise sample, and X(l) where l>L n is an interference sample, the noise variance is estimated to be σ n , and the noise sample ratio is η=L n /L. The reasonable range of setting l 0 is relatively loose, for example, l 0 /L=0.5 can meet the requirement, because generally speaking, the interference characteristic value is not too much.
采用算法对估计协方差矩阵的特征值进行分析,能够准确检测出因干扰引起的特征值,因为来自噪声本身的特征值会使得统计量持续的减少,而干扰特征值在幅度上的异常,会导致统计量急剧的上升。当干扰被计入时,统计量D突然急剧增大。待检验数据X中符合样本个数,可认为是统计量D随检验数据量变化最小值所对应样本序号,该样本序号所对应样本幅度,即为干扰特征值的阈值。Using the algorithm to analyze the eigenvalues of the estimated covariance matrix can accurately detect the eigenvalues caused by interference, because the eigenvalues from the noise itself will make the statistics continuously decrease, and the abnormal amplitude of the interference eigenvalues will cause lead to a sharp increase in statistics. When disturbances are taken into account, the statistic D suddenly increases dramatically. The number of conforming samples in the data X to be tested can be considered as the sample number corresponding to the minimum value of the statistic D changing with the amount of test data, and the sample amplitude corresponding to the sample number is the threshold of the interference characteristic value.
检测干扰特征值集合Σi后,确定其子空间Ui,则信号与噪声子空间为Ui的补集。基于此子空间进行投影,设计的接收机为After detecting the interference eigenvalue set Σ i , determine its subspace U i , then the signal and noise subspaces are the complement of U i . Based on this subspace for projection, the designed receiver is
图3表示干扰和信号的特征值分布。仿真中接收机权向量的维度为256,所估计协方差矩阵的阶数为256,其特征值个数,也即待检测的样本个数为256。其中,特征值按照从小到大进行排列,从图中可以清楚地看到,在未检测的干扰特征值时,信号的特征值分布均匀。当干扰的特征值被检测检测到时,由于干扰特征值相对信号的特征值幅度比较大,且变化非常明显。Figure 3 shows the distribution of eigenvalues of the interference and signal. In the simulation, the dimension of the receiver weight vector is 256, the order of the estimated covariance matrix is 256, and the number of its eigenvalues, that is, the number of samples to be detected is 256. Among them, the eigenvalues are arranged from small to large, and it can be clearly seen from the figure that when no interference eigenvalues are detected, the eigenvalues of the signal are evenly distributed. When the eigenvalue of the interference is detected, the amplitude of the eigenvalue of the interference is relatively large compared with the eigenvalue of the signal, and the change is very obvious.
图4表示采用Lilliefors检验的统计量。Lilliefors统计量随着较大特征值的加入,在干扰特征值被计入前后出现了急剧变化,与算法设计思想一致。Figure 4 shows statistics using the Lilliefors test. With the addition of larger eigenvalues, the Lilliefors statistic changes sharply before and after the interference eigenvalues are included, which is consistent with the design idea of the algorithm.
图5表示,利用本发明设计的异常值检测的子空间投影,仿真BPSK信号与干扰,抑制干扰之后,检测的误码率性能曲线。设置载波频率76Hz,采样频率256Hz,蒙特卡洛次数为1000。仿真结果可见,对比传统的匹配滤波器,本发明提取出的基于异常值检测的子空间投影滤波器算法可以自适应检测干扰特征值,得到信号子空间,抑制干扰,降低误码率。Fig. 5 shows the bit error rate performance curve of detection after using the subspace projection of outlier detection designed in the present invention to simulate BPSK signal and interference, and suppressing interference. Set the carrier frequency to 76Hz, the sampling frequency to 256Hz, and the Monte Carlo times to 1000. The simulation results show that, compared with the traditional matched filter, the outlier detection-based subspace projection filter algorithm extracted by the present invention can adaptively detect the interference characteristic value, obtain the signal subspace, suppress the interference, and reduce the bit error rate.
Claims (6)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810435822.0A CN108629125A (en) | 2018-05-08 | 2018-05-08 | Subspace projection filter design based on rejecting outliers |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810435822.0A CN108629125A (en) | 2018-05-08 | 2018-05-08 | Subspace projection filter design based on rejecting outliers |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108629125A true CN108629125A (en) | 2018-10-09 |
Family
ID=63692280
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810435822.0A Pending CN108629125A (en) | 2018-05-08 | 2018-05-08 | Subspace projection filter design based on rejecting outliers |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108629125A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110739986A (en) * | 2019-10-20 | 2020-01-31 | 广东石油化工学院 | PLC channel impulse noise detection method and system using projection cumulant |
| CN115021858A (en) * | 2021-03-05 | 2022-09-06 | 海能达通信股份有限公司 | Interference suppression method and related device, base station and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103942449A (en) * | 2014-05-05 | 2014-07-23 | 北京理工大学 | Feature interference cancellation beam forming method based on estimation of number of information sources |
| CN104144020A (en) * | 2014-06-30 | 2014-11-12 | 电子科技大学 | A Method for Measuring Phase Response Parameters of Antenna Array with Unknown Signal Direction |
| CN104408278A (en) * | 2014-10-09 | 2015-03-11 | 哈尔滨工程大学 | A method for forming steady beam based on interfering noise covariance matrix estimation |
| CN104865586A (en) * | 2015-06-15 | 2015-08-26 | 中国人民解放军国防科学技术大学 | Method for realizing interference resistance and multipath restraint of navigation receiver with array antenna |
| CN105044786A (en) * | 2015-05-14 | 2015-11-11 | 清华大学 | Pipeline robot extremely-low frequency signal detecting apparatus based on orthogonal coil sensors |
| CN105204006A (en) * | 2015-10-19 | 2015-12-30 | 电子科技大学 | Beam forming method based on subspace interference-plus-noise covariance matrix reconstruction |
| US20180070364A1 (en) * | 2016-09-08 | 2018-03-08 | Qualcomm Incorporated | Interference mitigation via space-time subspace projection |
-
2018
- 2018-05-08 CN CN201810435822.0A patent/CN108629125A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103942449A (en) * | 2014-05-05 | 2014-07-23 | 北京理工大学 | Feature interference cancellation beam forming method based on estimation of number of information sources |
| CN104144020A (en) * | 2014-06-30 | 2014-11-12 | 电子科技大学 | A Method for Measuring Phase Response Parameters of Antenna Array with Unknown Signal Direction |
| CN104408278A (en) * | 2014-10-09 | 2015-03-11 | 哈尔滨工程大学 | A method for forming steady beam based on interfering noise covariance matrix estimation |
| CN105044786A (en) * | 2015-05-14 | 2015-11-11 | 清华大学 | Pipeline robot extremely-low frequency signal detecting apparatus based on orthogonal coil sensors |
| CN104865586A (en) * | 2015-06-15 | 2015-08-26 | 中国人民解放军国防科学技术大学 | Method for realizing interference resistance and multipath restraint of navigation receiver with array antenna |
| CN105204006A (en) * | 2015-10-19 | 2015-12-30 | 电子科技大学 | Beam forming method based on subspace interference-plus-noise covariance matrix reconstruction |
| US20180070364A1 (en) * | 2016-09-08 | 2018-03-08 | Qualcomm Incorporated | Interference mitigation via space-time subspace projection |
Non-Patent Citations (3)
| Title |
|---|
| TAIFENG WU,ET AL: "Sea-clutter region extraction based on image segmentation methods for over-the-horizon radar", 《2018 IEEE RADAR CONFERENCE》 * |
| 罗忠涛等: "基于图像分割的高频雷达射频干扰提取算法", 《系统工程与电子技术》 * |
| 郑志勇等: "《金融数量分析 基于MATLAB编程》", 31 March 2018 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110739986A (en) * | 2019-10-20 | 2020-01-31 | 广东石油化工学院 | PLC channel impulse noise detection method and system using projection cumulant |
| CN115021858A (en) * | 2021-03-05 | 2022-09-06 | 海能达通信股份有限公司 | Interference suppression method and related device, base station and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113325277A (en) | Partial discharge processing method | |
| CN110717472B (en) | Fault Diagnosis Method and System Based on Improved Wavelet Threshold Denoising | |
| CN107818298B (en) | General Raman spectrum feature extraction method for machine learning substance identification algorithm | |
| CN106600602B (en) | Based on cluster adaptive windows hyperspectral image abnormal detection method | |
| CN106918567B (en) | A kind of method and apparatus measuring trace metal ion concentration | |
| CN118571774B (en) | Quick test method, equipment and system for MOSFET device | |
| CN117889965B (en) | Performance test method of medium-short wave double-color infrared detector | |
| CN117949800A (en) | A field effect transistor intelligent testing method and system | |
| CN108333443B (en) | Alarm method for intermittent defect of power equipment | |
| CN120253922B (en) | A soil heavy metal pollution detection method, device and system | |
| CN108629125A (en) | Subspace projection filter design based on rejecting outliers | |
| CN117951508B (en) | Data quality detection method and system based on Internet of things | |
| CN106877901B (en) | A kind of detection method of low noise than direct sequence signal | |
| CN105486991A (en) | Local discharge pulse extraction method | |
| CN106330361B (en) | Weak Signal Detection Method based on connectivity of graph analysis | |
| CN118707442A (en) | Signal arrival time estimation method, medium and device based on envelope amplitude judgment | |
| CN116877199B (en) | An adaptive dynamic monitoring and early warning method for rock burst in coal mines | |
| CN115598615B (en) | Power spectrum information geometric radar target detection method and device based on sub-band filtering | |
| CN117169193A (en) | Method for judging transformer oil insulation aging based on Raman spectrum peak identification | |
| CN117031294A (en) | Battery multi-fault detection method, device and storage medium | |
| JP4948238B2 (en) | Distribution analysis method and apparatus, abnormal equipment estimation method and apparatus, program for causing computer to execute distribution analysis method or abnormal equipment estimation method, and computer-readable recording medium recording the program | |
| CN109724637B (en) | Sensor element quality evaluation method based on test data | |
| CN114089307A (en) | Radar detection and classification method and system under target and interference conditions | |
| CN120011723B (en) | Signal detection method and system based on anti-eigenvalue of spearman rank correlation matrix | |
| CN113011261A (en) | Sinusoidal signal detection method and device based on graph |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20181009 |
|
| WD01 | Invention patent application deemed withdrawn after publication |