Robert FisherJust thinking out loud On floating pointIf you register and log in you can add comments to my pages. If viewing the main blog page, click the # underneath an entry to comment on it. A quote from FloatingPointFractions on c2.com: “every floating point number is an approximation of an infinite number of nearby non-rational real numbers” Side note: so-called “banker's rounding” rounds x.5 to the nearest even integer.
last updated 1 year ago # |