Entropy of a stationary process and entropy of a shift transformation in its sample space

Аннотация

We construct a class of non-Markov discrete-time stationary random processes with countably many states for which the entropy of the one-dimensional distribution is infinite, while the conditional entropy of the “present” given the “past” is finite and coincides with the metric entropy of a shift transformation in the sample space. Previously, such situation was observed in the case of Markov processes only.