Probabilistic measure of information. Introduction to compression algorithms including L-Z, MPEG, JPEG, and Huffman encoding. Determination of the information handling capacity of communication channels and fundamental coding theorems including Shannon's first and second channel coding theorems. Introduction to error correcting codes including block codes and convolutional coding and decoding using the Viterbi algorithm. Applications of information theory and coding to advanced coding modulation such as Trellis code Modulation (TCM) and turbo modulation.