Adaptive χ2 Test for Discriminating between Close Hypotheses with a Large Number of Classes and Its Application to Some Cryptography Problems

  • Authors:
  • B. Ya. Ryabko;V. S. Stognienko;Yu. I. Shokin

  • Affiliations:
  • Institute of Computational Technologies, Siberian Branch of the RAS, Novosibirsk ryabko@adm.ict.nsc.ru;Institute of Computational Technologies, Siberian Branch of the RAS, Novosibirsk;Institute of Computational Technologies, Siberian Branch of the RAS, Novosibirsk

  • Venue:
  • Problems of Information Transmission
  • Year:
  • 2003

Quantified Score

Hi-index 0.00

Visualization

Abstract

The main problem considered consists in testing the hypothesis H0 that letters of an alphabet A = {a1, a2, …, ak} are generated with equal probabilities 1/k against the alternative complex hypothesis H1, the negation of H0. In many applications, in particular, those connected with cryptography, k is large, but possible deviations from the uniform distribution are small. Therefore, application of Pearson's χ2 test, which is one of the most wide-spread and efficient tests, requires samples of a very large size, certainly exceeding k. We propose a so-called adaptive χ2 test, whose power can be considerably higher than that of the traditional method in the case described. This conclusion is based on the theoretical analysis of the proposed criterion for some classes of alternatives as well as on experimental results related to discriminating between enciphered Russian texts and random sequences.