Sample Space Reducing Processes

A Sample Space Reducing (SSR) process is a stochastic process whose sample space reduces as it evolves in time. In its simplest version, imagine a set of N states in a system, labelled by i = 1, 2, ... , N. The states are ordered by the label. The only rule that defines the SSR process is that transitions between states may only occur from higher to lower labels. This means that transition from state j to i is possible only if label j > i. When the lowest state i = 1 is reached, the process is restarted. This simple dynamics leads to a Zipf’s law in the frequency of state visits, i.e. the probability to visit state i is given by p(i) = 1/i (with a slope corresponding to the red straight line in the plot below with circles). This scaling law is extremely robust and occurs for a wide class of prior probabilities.
[ PNAS 112, 5348–5353, (2015) ]

Simulation rate

VDP Servedio@CSH Vienna