Information Theory: A Concise Introduction - cover image

Subscribe to our newsletter and we'll email you a 50 % off coupon for one ebook.

* indicates required

Back to

Information Theory: A Concise Introduction

Stefan Hollos, and J. Richard Hollos

Format and pricing:
paperback (136 pages) $14.95, Kindle/pdf $9.95
ISBN: 9781887187282 (paperback), 9781887187299 (ebook)
Publication date: May 2015

Buy pdf Amazon buy button

Books on information theory tend to fall into one of two extreme categories. There are large academic textbooks that cover the subject with great depth and rigor. Probably the best known of these is the book by Cover and Thomas. At the other extreme are the popular books such as the ones by Pierce and Gleick. They provide a very superficial introduction to the subject, enough to engage in cocktail party conversation but little else. This book attempts to bridge these two extremes.

This book is written for someone who is at least semi-mathematically literate and wants a concise introduction to some of the major concepts in information theory. The level of mathematics needed is very elementary. A rudimentary grasp of logarithms, probability, and basic algebra is all that is required. Two chapters at the end of the book provide a review of everything the reader needs to know about logarithms and discrete probability to get the most out of the book. Very little attention is given to mathematical proof. Instead the results are presented in a way that makes them almost obvious or at least plausible.

The book will appeal to anyone looking for a fast introduction to most of the major topics in information theory. An introduction that is concise but not superficial.

You can buy this book now at Amazon in paper or as a Kindle ebook.

Amazon buy button

You can also get the ebook instantly as a pdf from Gumroad where you will be able to download it immediately after purchase.

Buy pdf

About the authors: Stefan Hollos and J. Richard Hollos are physicists by training, and enjoy anything related to math, physics, and computing. They are the authors of Recursive Digital Filters: A Concise Guide, Art of Pi, Creating Noise, Art of the Golden Ratio, Creating Rhythms, Pattern Generation for Computational Art, Finite Automata and Regular Expressions: Problems and Solutions, Probability Problems and Solutions, Combinatorics Problems and Solutions, The Coin Toss: Probabilities and Patterns, Bet Smart: The Kelly System for Gambling and Investing, as well as Simple Trading Strategies That Work and Pairs Trading: A Bayesian Example, and are brothers and business partners at Exstrom Laboratories LLC in Longmont, Colorado. Their website is

Table of Contents


This software is free and distributed under the terms of the GNU General Public License. It is written in ANSI C and should compile with any C compiler. If you have questions or comments contact: Stefan (stefan at exstrom dot com) or Richard (richard at exstrom dot com).

Send comments to: Richard Hollos (richard[AT]exstrom DOT com)
Copyright 2015 by Exstrom Laboratories LLC