Maximization of empirical Shannon information in testing significant variables of linear model

M. Malyutov and H. Sadaka

No 1998,2, SFB 373 Discussion Papers from Humboldt University of Berlin, Interdisciplinary Research Project 373: Quantification and Simulation of Economic Processes

Abstract: Search for an unknown set A,Card(A) = s, of significant variables of a linear model with random IID discrete binary carriers and finitely supported IID noise is studied. Two statistics T1, Ts, based on maximization of Shannon Information (SI) of the corresponding classes of joint empirical input-output distributions, are proposed inspired by the related study in Csiszar and Körner (1981). The first one compares sequences of values of each variable and of the output separately. The second one explores the relation between the subsets of the (N x t) design matrix corresponding to each subset of variables of given cardinality and the output sequence. Here N is the number of experiments and t is the total number of variables. Both statistics are shown to be asymptotically as efficient as the ML-test for the corresponding classes of joint empirical distributions in the artificial case when ML-test is applicable: if the unknown parameters bλ, λ Є A, of the model and the distribution of errors are known. Our tests do not require this information. Therefore, they are asymptotically uniformly most efficient in the corresponding classes of tests. The second statistic is shown to provide asymptotically best rate of search for the set A of significant variables when tÇÉ but requires about ts log t cycles of computing. This may appear in accessible for actual computations in some applications. The first statistic requires only t log t cycles of computing operations and provides the best order of magnitude of the characteristics studied for the second class of tests.

Date: 1998
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
https://www.econstor.eu/bitstream/10419/61266/1/721077196.pdf (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:zbw:sfb373:19982

Access Statistics for this paper

More papers in SFB 373 Discussion Papers from Humboldt University of Berlin, Interdisciplinary Research Project 373: Quantification and Simulation of Economic Processes Contact information at EDIRC.
Bibliographic data for series maintained by ZBW - Leibniz Information Centre for Economics ().