Numerical accuracy control in fixed-point arithmetic

Long Ton-That

Mathematics and Computers in Simulation (MATCOM), 1988, vol. 30, issue 6, 553-561

Abstract: The purpose of this paper is to look at the problem of propagation of round-off errors in fixed-point arithmetic and at various problems of checking solutions of equations already treated by La Porte and Vignes in the case of floating-point arithmetic. We first consider the probabilistic model for the numerical fixed-point representation on a computer, the evaluation of the mean value and of the standard deviation for the absolute error of the assignment operator A, and of elementary operators of arithmetic. We then compute the statistical estimate of the error in the computation of an inner product, and this leads us to the problem of checking the accuracy of the solution of linear systems and of algebraic equations.

Date: 1988
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (1)

Downloads: (external link)
http://www.sciencedirect.com/science/article/pii/0378475488900766
Full text for ScienceDirect subscribers only

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:eee:matcom:v:30:y:1988:i:6:p:553-561

DOI: 10.1016/0378-4754(88)90076-6

Access Statistics for this article

Mathematics and Computers in Simulation (MATCOM) is currently edited by Robert Beauwens

More articles in Mathematics and Computers in Simulation (MATCOM) from Elsevier
Bibliographic data for series maintained by Catherine Liu ().