TSVD truncate small singular values by truncation parameter to improve the parameter estimation of ill-posed model. From the perspective of MSE (mean squared error), TSVD introduce biases to reduce variances, therefore the stability and reliability of the solution can be improved. Truncation parameter is key factor of TSVD, but it is difficult to determine in case of the gently declined singular values. The parameter determined by GCV (generalized cross-validation) and L-curve often unstable and unreliable. And the minimum MSE method is limited by the accuracy of the estimated MSE. This paper compares the changes of variance and bias produced by truncating the singular values in turn and determines the truncation parameter when the reduced variance is less than the introduced bias. In order to avoid the comparison between reduced variance and introduced bias of truncating small singular values, the confidence domain of bias is established through estimating the introduced bias of truncating big singular values that are proved to be reliable. The comparisons are replaced by comparing the reduced variance with the bias in the confidence domain. Therefore, the issue of introduced bias of truncating small singular values cannot be calculated without true values of unknown parameters is solved. Numerical examples proves the feasibility and effectiveness of the new method. Truncation parameters determined by new method are more stable and reliable than GCV and L-curve and improve the TSVD solution effectively.
[1] 王振杰, 欧吉坤, 柳林涛. 单频GPS快速定位中病态问题的解法研究[J]. 测绘学报, 2005, 34(3): 196-201. DOI: 10.3321/j.issn:1001-1595.2005.03.002. WANG Zhenjie, OU Jikun, LIU Lintao. Investigation on Solutions of Ill-conditioned Problems in Rapid Positioning Using Single Frequency GPS Receivers[J]. Acta Geodaetica et Cartographica Sinica, 2005, 34(3): 196-201. DOI: 10.3321/j.issn:1001-1595.2005.03.002.
[2] LI Bofeng, SHEN Yunzhong,FENG Yanming.Fast GNSS Ambiguity Resolution as an Ill-posed Problem[J]. Journal of Geodesy, 2010, 84(11): 683-698.
[3] DAI Wujiao, LIU Bin, DING Xiaoli, et al. Modeling Dam Deformation Using Independent Component Regression Method[J]. Transactions of Nonferrous Metals Society of China, 2013, 23(7): 2194-2200.
[4] XU Chang, DENG Chengfa. Solving Multicollinearity in Dam Regression Model Using TSVD[J]. Geo-Spatial Information Science, 2011, 14(3): 230-234.
[5] 徐新禹, 李建成, 王正涛, 等. Tikhonov正则化方法在GOCE重力场求解中的模拟研究[J]. 测绘学报, 2010, 39(5): 465-470. XU Xinyu, LI Jiancheng, WANG Zhengtao, et al. The Simulation Research on the Tikhonov Regularization Applied in Gravity Field Determination of GOCE Satellite Mission[J]. Acta Geodaetica et Cartographica Sinica, 2010, 39(5): 465-470.
[6] 顾勇为, 归庆明. 航空重力测量数据向下延拓基于信噪比的正则化方法的研究[J]. 测绘学报, 2010, 39(5): 458-464. GU Yongwei, GUI Qingming. Study of Regularization Based on Signal-to-noise Index in Airborne Gravity Downward to the Earth Surface[J]. Acta Geodaetica et Cartographica Sinica, 2010, 39(5): 458-464.
[7] SAVE H, BETTADPUR S, TAPLEY B D. Reducing Errors in the GRACE Gravity Solutions Using Regularization[J]. Journal of Geodesy, 2012, 86(9): 695-711.
[8] 崔希璋, 於宗俦, 陶本藻, 等. 广义测量平差[M]. 武汉: 武汉测绘科技大学出版社, 2001. CUI Xizhang, YU Zongchou, TAO Benzao, et al. Generalized Surveying Adjustment[M]. Wuhan: Wuhan Technical University of Surveying and Mapping Press, 2001.
[9] TIKHONOV A N. Solution of Incorrectly Formulated Problems and the Regularization Method[M]. Doklady Akademii Nauk SSSR. Soviet: [s.n.], 1963: 501-504.
[10] TIKHONOV A N, ARSENIN V Y. Solutions of Ill-posed Problems[M]. New York: Wiley, 1977.
[11] HOERL A E, KENNARD R W. Ridge Regression: Biased Estimation for Nonorthogonal Problems[J]. Technometrics, 1970, 12(1): 55-67.
[12] HOERL A E, KENNARD R W. Ridge Regression: Applications to Nonorthogonal Problems[J]. Technometrics, 1970, 12(1): 69-82.
[13] XU Peiliang. Truncated SVD Methods for Discrete Linear Ill-posed Problems[J]. Geophysical Journal International, 1998, 135(2): 505-514.
[14] HANSEN P C. The Truncated SVD as a Method for Regularization[J]. BIT Numerical Mathematics, 1987, 27(4): 534-553.
[15] BOUHAMIDI A, JBILOU K, REICHEL L, et al. An Extrapolated TSVD Method for Linear Discrete Ill-posed Problems with Kronecker Structure[J]. Linear Algebra and Its Applications, 2011, 434(7): 1677-1688.
[16] REICHEL L, RODRIGUEZ G. Old and New Parameter Choice Rules for Discrete Ill-posed Problems[J]. Numerical Algorithms, 2013, 63(1): 65-87.
[17] GOLUB G H, HEATH M, WAHBA G. Generalized Cross-validation as a Method for Choosing a Good Ridge Parameter[J]. Technometrics, 1979, 21(2): 215-223.
[18] SOURBRON S, LUYPAERT R, VAN SCHUERBEEK P, et al. Choice of the Regularization Parameter for Perfusion Quantification with MRI[J]. Physics in Medicine and Biology, 2004, 49(14): 3307-3324.
[19] 吴太旗, 邓凯亮, 黄谟涛, 等. 一种改进的不适定问题奇异值分解法[J]. 武汉大学报(信息科学版), 2011, 36(8): 900-903. WU Taiqi, DENG Kailiang, HUANG Motao, et al. An Improved Singular Values Decomposition Method for Ill-posed Problem[J]. Geomatics and Information Science of Wuhan University, 2011, 36(8): 900-903.
[20] HANSEN P C, O'LEARY D P. The Use of the L-curve in the Regularization of Discrete Ill-posed Problems[J]. SIAM Journal on Scientific Computing, 1993, 14(6): 1487-1503.
[21] 朱建军, 田玉淼, 陶肖静. 带准则参数的平差准则及其统一与解算[J]. 测绘学报, 2012, 41(1): 8-13. ZHU Jianjun, TIAN Yumiao, TAO Xiaojing. United Expression and Solution of Adjustment Criteria with Parameters[J]. Acta Geodaetica et Cartographica Sinica, 2012, 41(1): 8-13.
[22] 叶松林, 朱建军. 矩阵奇异值分解与广义岭估计及其在测量中的应用[J]. 中国有色金属学报, 1998, 8(1): 160-164. YE Songlin, ZHU Jianjun. Application of Singular Value Decomposition and Generalized Ridge Estimation in Surveying[J]. The Chinese Journal of Nonferrous Metals, 1998, 8(1): 160-164.
[23] HANSEN P C. Analysis of Discrete Ill-posed Problems By Means of the L-curve[J]. SIAM Review, 1992, 34(4): 561-580.
[24] SHEN Yunzhong,XU Peiliang, LI Bofeng. Bias-corrected Regularized Solution to Inverse Ill-posed Models[J]. Journal of Geodesy, 2012, 86(8): 597-608.
[25] TIKHONOV A N,GONCHARSKY A V,STEPANOV V V, et al. Numerical Methods for the Solution of Ill-posed Problems[M].Netherlands:Kluwer Academic Publishers,1995.
[26] 付海强, 朱建军, 汪长城, 等. 极化干涉SAR植被高反演复数最小二乘平差法[J]. 测绘学报, 2014, 43(10): 1061-1067. DOI: 10.13485/j.cnki.11-2089.2014.0170. FU Haiqiang, ZHU Jianjun, WANG Changcheng, et al. Polarimetric SAR Interferometry Vegetation Height Inversion Method of Complex Least Squares Adjustment[J]. Acta Geodaetica et Cartographica Sinica, 2014, 43(10): 1061-1067. DOI: 10.13485/j.cnki.11-2089.2014.0170.
[27] 付海强. 基于测量平差理论的PolInSAR植被垂直结构提取模型与方法[D]. 长沙: 中南大学, 2014. FU Haiqiang. Theory and Method of Extracting Vegetation Vertical Structure with PolInSAR Based on Surveying Adjustment[D]. Changsha: Central South University, 2014.