← Parminces
Shen, Uspensky & Vereshchagin (AMS, 2017)

Kolmogorov Complexity and
Algorithmic Randomness

A rigorous journey through algorithmic information theory, from the shortest description of a string to the deepest notion of randomness. Rebuilt chapter by chapter as interactive lessons.

11
Chapters
30+
Simulations
60+
Quizzes
Part I: Foundations of Complexity
Introduction

What Is This Book About?

Optimal descriptions, Kolmogorov complexity, Berry's paradox, and first applications.

Chapter 1

Plain Kolmogorov Complexity

Definition, counting argument, incompressible strings, and algorithmic properties.

Chapter 2

Complexity of Pairs & Conditional Complexity

Encoding pairs, conditional descriptions, the Kolmogorov-Levin theorem.

Part II: Algorithmic Randomness
Chapter 3

Martin-Löf Randomness

Measures, the Strong Law, effectively null sets, and randomness deficiencies.

Chapter 4

A Priori Probability & Prefix Complexity

Semimeasures, prefix machines, the main theorem on prefix complexity.

Chapter 5

Monotone Complexity

Levin-Schnorr theorem, the random number Ω, Hausdorff dimension.

Part III: Structure and Connections
Chapter 6

General Scheme for Complexities

Decision complexity, comparing complexities, conditional variants, oracles.

Chapter 7

Shannon Entropy & Kolmogorov Complexity

Shannon entropy, conditional entropy, the bridge between information theory and complexity.

Chapter 8

Some Applications

Infinitely many primes, tape complexity, finite automata, forbidden substrings.

Part IV: Advanced Topics
Chapter 9

Frequency & Game Approaches to Randomness

Von Mises, martingales, Schnorr randomness, effective dimension.

Chapter 10

Inequalities for Entropy, Complexity, and Size

Uniform sets, typization, combinatorial interpretations of information inequalities.