Data compression is one of the most important fields and tools in modern computing. From archiving data, to CD-ROMs, and from coding theory to image analysis, many facets of modern computing rely upon
The textbook for a first course in information theory introduces differential entropy as a measure for the limit on data compression. It begins with a brief review of probability theory, which provide