Those "ridiculous little errors" are artifacts of the translation of base 10 (decimal) numbers that include a fractional part being translated to floating point base 2 (binary) numbers of fixed precision for calculation by the computer, then being translated back to base 10 for display.
The problem is a simple one: there are decimal fractions that can be represented exactly in base 10 that simply cannot be represented exactly in fixed precision floating point binary numbers.
Binary floating point calculations follow The IEEE Standard for Floating-Point Arithmetic (IEEE 754), originally written in 1985, the current version (according to the Wikipedia article on the topic) is the 2008 revision.
For the precision expected in 'ordinary' arithmetic, rounding your final result to a set number of places after the decimal will usually suffice. A general rule of thumb is to round final results to a precision no greater than the lowest precision of any input value obtained by measuring.
For either of the 'ridiculous small error' examples supplied above, rounding to any where from 4 to 'one fewer than displayed in the example' places after the decimal should produce the precise result you expect. Rounding to four places will produce that result with no trailing zeros.
ROUND(formula,4)
Regards,
Barry