Module 1 Overview
In this module, you will learn about what type of numbers computers work with, how accurate computations are, and how this impacts the results of more complex numerical computations.
Learning Objectives:
By the end of this module, you will be able to:
- demonstrate finite precision defined in IEEE-754 (half/single/double precision).
- identify round-off vs truncation errors
This lecture is under "Module 1: Round-off and Truncation Errors"
Lecture 1-1: Binary to Decimal Conversion
Lecture 1-2: Decimal to Binary Conversion
Lecture 1-3: Engineering Notation
Lecture 1-4: IEEE-754
Lecture 1-5: Round-off Truncation and True Errors (Part 1)
Lecture 1-6: Round-off Truncation and True Errors (Part 2)
