ENEE627

Information Theory

Prerequisite: ENEE620. Credit only granted for: ENEE627 or ENEE721. Formerly: ENEE721. Information measures and their properties; entropy, relative entropy and mutual information. Information source models. Lossless data compression: the Kraft inequality, Shannon-Fano and Huffman codes. Typical sequences, asymptotic equipartition property, lossy source coding. Discrete memoryless channels: capacity, channel coding theorem. The additive Gaussian channel. Source coding under a fidelity constraint: rate distortion function and rate distortion theorem.

Spring 2026

0 reviews
Average rating: N/A

Spring 2025

0 reviews
Average rating: N/A

Past Semesters

0 reviews
Average rating: N/A

0 reviews
Average rating: N/A

0 reviews
Average rating: N/A

0 reviews
Average rating: N/A

0 reviews
Average rating: N/A

During the Spring 2020 and Spring 2021 semesters, students could choose to take some of their courses pass-fail mid-semester which skews grade data aggregated across multiple semesters.

Average GPA of 3.14 between 270 students*

ENEE627 Grade Distribution+-0510152025303540% of studentsABCDFWother
A-: 11.48%
A: 24.81%
A+: 3.7%
B-: 7.78%
B: 17.78%
B+: 13.7%
C-: 1.48%
C: 5.93%
C+: 1.48%
D-: 0.37%
D: 1.48%
F: 0.74%
W: 3.33%
other: 5.93%
* "W"s are considered to be 0.0 quality points. "Other" grades are not factored into GPA calculation. Grade data not guaranteed to be correct.