Access the full text.
Sign up today, get DeepDyve free for 14 days.
References for this paper are not available at this time. We will be adding them shortly, thank you for your patience.
CHAP TER 3 An Overview of Information Theory and Error-Correcting Codes 3.1 INTRODUCTION At variance with molecular genetics, I am afraid that popular books dealing with information theory pale in comparison to that of Dawkins’s. Indeed, it is especially difficult to give a fair account of information theory without having recourse to mathematical concepts and notations. For the following rough discussion of information theory, I assume that the reader is reasonably familiar with mathematics at the undergraduate level. In the literature, I often find concepts alleged as belonging to information theory but which engineers do not recognize as such; then, ‘information theory’ is used as a label for topics more or less loosely related to it. I must state that in this lecture I’ll restrict information theory to the science of literal communication, as Shannon expounded it in [72], to its further elaboration and its engineering applications. Other attempts to build information theories were made, some of them rather speculative, but only Shannon’s theory has proved to be both rigorous and fully operational (if we except the algorithmic information theory to be briefly discussed in Sec. 5.4 below). Restricting information theory here to Shannon’s legacy is not attempting to
Published: Jan 1, 2008
Read and print from thousands of top scholarly journals.
Already have an account? Log in
Bookmark this article. You can see your Bookmarks on your DeepDyve Library.
To save an article, log in first, or sign up for a DeepDyve account if you don’t already have one.
Copy and paste the desired citation format or use the link below to download a file formatted for EndNote
Access the full text.
Sign up today, get DeepDyve free for 14 days.
All DeepDyve websites use cookies to improve your online experience. They were placed on your computer when you launched this website. You can change your cookie settings through your browser.