Probabilistic Examination of Least Squares Error in Low-bitwidth Cholesky Decomposition
2024 26th International Conference on Digital Signal Processing and its Applications (DSPA)(2024)
摘要
In this paper, we propose a new approach to justify a round-off error impact
on the accuracy of the linear least squares (LS) solution using Cholesky
decomposition. This decomposition is widely employed to inverse a matrix in the
linear detector of the Multi-User multi-antenna receiver. The proposed
stochastic bound is much closer to actual errors than other numerical bounds.
It was tested with a half-precision format and validated in realistic
scenarios. Experimental results demonstrate our approach predicts errors very
close to those achieved by simulations. The proposed approach can be employed
to analyze the resulting round-off error in many other applications.
更多查看译文
关键词
Round-off error,Cholesky decomposition
AI 理解论文
溯源树
样例
![](https://originalfileserver.aminer.cn/sys/aminer/pubs/mrt_preview.jpeg)
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要