Please tell us a little bit about yourself

Search the: Search the directory Website Directory

Apply Donate Crisis Centre

Services and information

Accessibility
Bookstore
Brand Central
IT services
Library
Service disruptions

Safety and security

Campus emergencies
Campus safety
Health and Safety
Mental health and wellness
Sexual violence support and education

Faculty and staff

Faculties and departments
Faculty resources
Resources and services

Students

Academic Calendar
Canvas
MyOntarioTech
Ridgebacks
Student email

Ontario Tech home page

Academic Calendar

Ontario Tech home page

Undergraduate

Apply now
Academics
Blog
Connect with us
English Language Centre
International applicants
International Office
Programs
More in Undergraduate

Graduate

Application process and requirements
Doctoral Programs
Graduate diploma programs
Graduate student awards
International applicants
Master’s programs
Tours and events
Contact
More in Graduate

Programs

Programs by faculty
Undergraduate
Graduate
College-to-university transfer
Direct entry co-op
Online programs
Pre-med programs
Continuous Learning
More in Programs

Student life

Contact us
Indigenous Hub
International Office
Parents and Families
Services
Varsity Athletics

Undergraduate

Academic Advising
Academic calendar
Academic Integrity
Change of program
Convocation
Course registration
Fees and payment
Important dates and deadlines
More in Undergraduate

Graduate

Communicating with you
Grad student toolkit
Graduate Academic Calendar
Course registration
Grad Pro Skills (GPS)
Important dates
Student finances
Student forms and publications
More in Graduate

Student life

Contact us
Accessibility
Student Learning Centre
Career Readiness
Community
Equity and Inclusion
Health and Wellness
Indigenous Education and Cultural Services
More in Student life

Campus services

Bookstore
Campus Libraries
Office of Campus Safety
Directions and transit
- Car
- Transit
- Train
- Plane
- Parking
- U-Pass
Food services
Health centre
- Campus Health Centre
Housing options
- On-campus
- Off-campus
Ontario Tech Ucard
More in Campus services

Research

Discover Research
Entrepreneurship
- Brilliant Entrepreneurship
Faculty
IRIS Research Portal
Partnerships & Innovation
Students

Research Facilities

CERL building — Clean Energy Research Laboratory (CERL)

ONTARIO-TECH-CMCC Institute for Disability and Rehabilitation Research

Giving

Donate

UOIT donors — Memorial and Tribute Gifts

A male and female studnet looking at the UOIT buildings

Giving at Ontario Tech

Our faculty and students are at the leading edge of research in Canada, developing innovative solutions to today’s complex problems. Your support is building a better world.

Donate now

Facebook
Twitter
Instagram
LinkedIn
YouTube

2000 Simcoe Street North
Oshawa, Ontario L1G 0C5
Canada

905.721.8668

Ontario Tech University is the brand name used to refer to the University of Ontario Institute of Technology.

Ontario Tech acknowledges the lands and people of the Mississaugas of Scugog Island First Nation which is covered by the Williams Treaties and are the traditional territory of the Mississaugas, a branch of the greater Anishinaabeg Nation, including Algonquin, Ojibway, Odawa and Pottawatomi. Learn more.

Top

University of Ontario Institute of Technology

Feb 10, 2025

2019-2020 Graduate Academic Calendar

Select a Calendar

Global Search Calendar Search
Choose Search Location

Search Keyword Field

Whole Word/Phrase
Advanced search

Catalog Navigation

Calendar Home

Programs (a to z)

Programs (by degree)

Programs (by faculty)

Programs (by subject area)

Course descriptions

Academic regulations

Governance

Calendar notice and disclaimer

Student privacy

Academic schedule

Fees and charges

Glossary

My favourites

HELP

2019-2020 Graduate Academic Calendar [ARCHIVED CALENDAR]

Print-Friendly Page (opens a new window)

Add to favourites (opens a new window)

ENGR 5680G - Information Theory

This course covers in detail Shannon’s mathematical theory of communication, 1948 to present; entropy, relative entropy, and mutual information for discrete and continuous random variables; Shannon’s source and channel coding theorems; mathematical models for information sources and communication channels, including memoryless, first-order Markov, ergodic, and Gaussian; calculation of capacity-cost and rate-distortion functions; Kolmogorov complexity and universal source codes; side information in source coding and communications; network information theory, including multiuser data compression, multiple access channels, broadcast channels and multi-terminal networks; and discussion of philosophical and practical implications of the theory.
Credit hours: 3

Add to favourites (opens a new window)