eciv 201 computational methods for civil engineers
DESCRIPTION
ECIV 201 Computational Methods for Civil Engineers. Error Analysis. Richard P. Ray, Ph.D., P.E. Approximations and Round-Off Errors. For many engineering problems, we cannot obtain analytical solutions. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: ECIV 201 Computational Methods for Civil Engineers](https://reader036.vdocuments.us/reader036/viewer/2022062315/568162ab550346895dd32d9d/html5/thumbnails/1.jpg)
USC
ECIV 201 Computational Methodsfor Civil Engineers
Richard P. Ray, Ph.D., P.E.
Error Analysis
![Page 2: ECIV 201 Computational Methods for Civil Engineers](https://reader036.vdocuments.us/reader036/viewer/2022062315/568162ab550346895dd32d9d/html5/thumbnails/2.jpg)
USC
Approximations and Round-Off Errors• For many engineering problems, we cannot obtain analytical
solutions.• Numerical methods yield approximate results, results that are
close to the exact analytical solution. We cannot exactly compute the errors associated with numerical methods.– Only rarely given data are exact, since they originate from
measurements. Therefore there is probably error in the input information.
– Algorithm itself usually introduces errors as well, e.g., unavoidable round-offs, etc …
– The output information will then contain error from both of these sources.
2
![Page 3: ECIV 201 Computational Methods for Civil Engineers](https://reader036.vdocuments.us/reader036/viewer/2022062315/568162ab550346895dd32d9d/html5/thumbnails/3.jpg)
USC
Approximation and Round-off Errors
How confident we are in our approximate result?
The question is “how much error is present in our calculation and is it tolerable?”
![Page 4: ECIV 201 Computational Methods for Civil Engineers](https://reader036.vdocuments.us/reader036/viewer/2022062315/568162ab550346895dd32d9d/html5/thumbnails/4.jpg)
USC
Accuracy. How close is a computed or measured value to the true value
Precision (or reproducibility). How close is a computed or measured value to previously computed or measured values.
Inaccuracy (or bias). A systematic deviation from the actual value.
Imprecision (or uncertainty). Magnitude of scatter.
4
![Page 5: ECIV 201 Computational Methods for Civil Engineers](https://reader036.vdocuments.us/reader036/viewer/2022062315/568162ab550346895dd32d9d/html5/thumbnails/5.jpg)
USC5
![Page 6: ECIV 201 Computational Methods for Civil Engineers](https://reader036.vdocuments.us/reader036/viewer/2022062315/568162ab550346895dd32d9d/html5/thumbnails/6.jpg)
USC
Significant Figures Number of significant figures indicates precision. Significant digits of a
number are those that can be used with confidence, e.g., the number of certain digits plus one estimated digit.
53,800 How many significant figures?
5.38 x 104 35.380 x 104 45.3800 x 104 5
Zeros are sometimes used to locate the decimal point not significant figures.
0.00001753 40.0001753 40.001753 4
6
![Page 7: ECIV 201 Computational Methods for Civil Engineers](https://reader036.vdocuments.us/reader036/viewer/2022062315/568162ab550346895dd32d9d/html5/thumbnails/7.jpg)
USC
Error DefinitionsTrue Value = Approximation + Error
Et = True value – Approximation (+/-)
valuetrueerror true error relative fractional True
%100 valuetrueerror true error, relativepercent True t
7
True error
![Page 8: ECIV 201 Computational Methods for Civil Engineers](https://reader036.vdocuments.us/reader036/viewer/2022062315/568162ab550346895dd32d9d/html5/thumbnails/8.jpg)
USC
For numerical methods, the true value will be known only when we deal with functions that can be solved analytically (simple systems). In real world applications, we usually will not know the answer a priori. Then
Iterative approach, example Newton’s method
%100ionApproximaterror eApproximat a
%100ionapproximatCurrent
ionapproximat Previous -ion approximatCurrent a
8
(+ / -)
![Page 9: ECIV 201 Computational Methods for Civil Engineers](https://reader036.vdocuments.us/reader036/viewer/2022062315/568162ab550346895dd32d9d/html5/thumbnails/9.jpg)
USC
Use absolute value. Computations are repeated until stopping criterion is satisfied.
If the following criterion is met
you can be sure that the result is correct to at least n significant figures.
sa
)%10 (0.5 n)-(2s
9
Pre-specified % tolerance based on the knowledge of your
solution
![Page 10: ECIV 201 Computational Methods for Civil Engineers](https://reader036.vdocuments.us/reader036/viewer/2022062315/568162ab550346895dd32d9d/html5/thumbnails/10.jpg)
USC
Round-off Errors Numbers such as p, e, or cannot be expressed by a
fixed number of significant figures. Computers use a base-2 representation, they cannot
precisely represent certain exact base-10 numbers. Fractional quantities are typically represented in
computer using “floating point” form, e.g.,
7
em.b
10
exponent
Base of the number system used
mantissa
Integer part
![Page 11: ECIV 201 Computational Methods for Civil Engineers](https://reader036.vdocuments.us/reader036/viewer/2022062315/568162ab550346895dd32d9d/html5/thumbnails/11.jpg)
USC11
![Page 12: ECIV 201 Computational Methods for Civil Engineers](https://reader036.vdocuments.us/reader036/viewer/2022062315/568162ab550346895dd32d9d/html5/thumbnails/12.jpg)
USC12
![Page 13: ECIV 201 Computational Methods for Civil Engineers](https://reader036.vdocuments.us/reader036/viewer/2022062315/568162ab550346895dd32d9d/html5/thumbnails/13.jpg)
USC
156.78 0.15678x103 in a floating point base-10 system
Suppose only 4 decimal places to be stored
Normalized to remove the leading zeroes. Multiply the mantissa by 10 and lower the exponent by 1
0.2941 x 10-1
121100294.0
029411765.0341
0
m
13
Additional significant figure is retained
![Page 14: ECIV 201 Computational Methods for Civil Engineers](https://reader036.vdocuments.us/reader036/viewer/2022062315/568162ab550346895dd32d9d/html5/thumbnails/14.jpg)
USC
Thereforefor a base-10 system 0.1 ≤m<1for a base-2 system 0.5 ≤m<1
Floating point representation allows both fractions and very large numbers to be expressed on the computer. However, Floating point numbers take up more room. Take longer to process than integer numbers. Round-off errors are introduced because mantissa holds
only a finite number of significant figures.
11m
b
14
![Page 15: ECIV 201 Computational Methods for Civil Engineers](https://reader036.vdocuments.us/reader036/viewer/2022062315/568162ab550346895dd32d9d/html5/thumbnails/15.jpg)
USC
ChoppingExample:p=3.14159265358 to be stored on a base-10 system
carrying 7 significant digits.p=3.141592 chopping error t=0.00000065If roundedp=3.141593 t=0.00000035 Some machines use chopping, because rounding adds
to the computational overhead. Since number of significant figures is large enough, resulting chopping error is negligible.
15
![Page 16: ECIV 201 Computational Methods for Civil Engineers](https://reader036.vdocuments.us/reader036/viewer/2022062315/568162ab550346895dd32d9d/html5/thumbnails/16.jpg)
USC
Truncation Errors and the Taylor Series
Non-elementary functions such as trigonometric, exponential, and others are expressed in an approximate fashion using Taylor series when their values, derivatives, and integrals are computed.
Any smooth function can be approximated as a polynomial. Taylor series provides a means to predict the value of a function at one point in terms of the function value and its derivatives at another point.
16
![Page 17: ECIV 201 Computational Methods for Civil Engineers](https://reader036.vdocuments.us/reader036/viewer/2022062315/568162ab550346895dd32d9d/html5/thumbnails/17.jpg)
USC17
![Page 18: ECIV 201 Computational Methods for Civil Engineers](https://reader036.vdocuments.us/reader036/viewer/2022062315/568162ab550346895dd32d9d/html5/thumbnails/18.jpg)
USC
Example:To get the cos(x) for small x:
If x=0.5cos(0.5) =1-0.125+0.0026041-0.0000127+ …
=0.877582From the supporting theory, for this series, the error is no greater than the first omitted term.
!6!4!2
1cos642 xxxx
0000001.05.0!8
8
xforx
18
![Page 19: ECIV 201 Computational Methods for Civil Engineers](https://reader036.vdocuments.us/reader036/viewer/2022062315/568162ab550346895dd32d9d/html5/thumbnails/19.jpg)
USC
• Any smooth function can be approximated as a polynomial.f(xi+1) ≈ f(xi) zero order approximation, only true if xi+1 and xi are very close to each other.
f(xi+1) ≈ f(xi) + f′(xi) (xi+1-xi) first order approximation, in form of a straight line
19
nn
iii
n
iii
iiiii
Rxxn
xf
xxxfxxxfxfxf
)(!
)(
)(!2
)())(()()(
1
)(
2111
![Page 20: ECIV 201 Computational Methods for Civil Engineers](https://reader036.vdocuments.us/reader036/viewer/2022062315/568162ab550346895dd32d9d/html5/thumbnails/20.jpg)
USC
nn
ii
n
iiiiiii
Rxxn
f
xxfxxxfxfxf
)(!
)(!2
))(()()(
1
)(
2111
)1()1(
)!1()(
n
n
n hn
fR
20
(xi+1-xi)= h step size (define first)
• Reminder term, Rn, accounts for all terms from (n+1) to infinity.
nth order approximation
![Page 21: ECIV 201 Computational Methods for Civil Engineers](https://reader036.vdocuments.us/reader036/viewer/2022062315/568162ab550346895dd32d9d/html5/thumbnails/21.jpg)
USC
• is not known exactly, lies somewhere between xi+1> >xi .
• Need to determine f n+1(x), to do this you need f'(x).
• If we knew f(x), there wouldn’t be any need to perform the Taylor series expansion.
• However, R=O(hn+1), (n+1)th order, the order of truncation error is hn+1.
• O(h), halving the step size will halve the error.• O(h2), halving the step size will quarter the
error.
21
![Page 22: ECIV 201 Computational Methods for Civil Engineers](https://reader036.vdocuments.us/reader036/viewer/2022062315/568162ab550346895dd32d9d/html5/thumbnails/22.jpg)
USC
Truncation error is decreased by addition of terms to the Taylor series.
If h is sufficiently small, only a few terms may be required to obtain an approximation close enough to the actual value for practical purposes.
Example:Calculate series, correct to the 3 digits.
41
31
211
22
![Page 23: ECIV 201 Computational Methods for Civil Engineers](https://reader036.vdocuments.us/reader036/viewer/2022062315/568162ab550346895dd32d9d/html5/thumbnails/23.jpg)
USC
Error Propagation fl(x) refers to the floating point (or computer)
representation of the real number x. Because a computer can hold a finite number of significant figures for a given number, there may be an error (round-off error) associated with the floating point representation. The error is determined by the precision of the computer ().
23
![Page 24: ECIV 201 Computational Methods for Civil Engineers](https://reader036.vdocuments.us/reader036/viewer/2022062315/568162ab550346895dd32d9d/html5/thumbnails/24.jpg)
USC
Suppose that we have a function f(x) that is dependent on a single independent variable x. fl(x) is an approximation of x and we would like to estimate the effect of discrepancy between x and fl(x) on the value of the function:
))(()()(sorder termhigher and second the
dropping ),f(xnear f(x) compute toseriesTaylor Employ
unknown are and f(x)both )()()(
fl
fl
flflfl
flfl
xxxfxfxf
xxfxfxf
24
![Page 25: ECIV 201 Computational Methods for Civil Engineers](https://reader036.vdocuments.us/reader036/viewer/2022062315/568162ab550346895dd32d9d/html5/thumbnails/25.jpg)
USC
Figure 4.7
25
![Page 26: ECIV 201 Computational Methods for Civil Engineers](https://reader036.vdocuments.us/reader036/viewer/2022062315/568162ab550346895dd32d9d/html5/thumbnails/26.jpg)
USC
Also, let t, the fractional relative error, be the error associated with fl(x). Then
Rearranging, we get
tt wherex
xxfl )(
)1()(
)(
t
t
xxfl
xxxfl
26
Machine epsilon, upper boundary
![Page 27: ECIV 201 Computational Methods for Civil Engineers](https://reader036.vdocuments.us/reader036/viewer/2022062315/568162ab550346895dd32d9d/html5/thumbnails/27.jpg)
USC
Case 1: Addition of x1 and x2 with associated errors t1 and t2 yields the following result:fl(x1)=x1(1+t1)fl(x2)=x2(1+t2)
fl(x1)+fl(x2)=t1 x1+t2 x2+x1+x2
21
2211
21
2121 )()()(%100 xx
xxxx
xxxflxfl ttt
27
• A large error could result from addition if x1 and x2 are almost equal magnitude but opposite sign, therefore one should avoid subtracting nearly equal numbers.
![Page 28: ECIV 201 Computational Methods for Civil Engineers](https://reader036.vdocuments.us/reader036/viewer/2022062315/568162ab550346895dd32d9d/html5/thumbnails/28.jpg)
USC
Generalization:Suppose the numbers fl(x1), fl(x2), fl(x3), …, fl(xn) are approximations to x1, x2, x3, … ,xn and that in each case the maximum possible error is E.
fl(xi)-E ≤ xi ≤ fl(xi)+E Eti ≤EIt follows by addition that
nExflxnExfl iii )()(
nExflxnE ii )(
28
nE
So that
Therefore, the maximum possible error in the sum of fl(xi) is .
![Page 29: ECIV 201 Computational Methods for Civil Engineers](https://reader036.vdocuments.us/reader036/viewer/2022062315/568162ab550346895dd32d9d/html5/thumbnails/29.jpg)
USC
Case 2: Multiplication of x1 and x2 with associated errors et1 and et2 results in:
212121
2121
21212121
221121
)()(%100
)1()()()1()1()()(
ttttt
tttt
tt
xxxxxflxfl
xxxflxflxxxflxfl
29
![Page 30: ECIV 201 Computational Methods for Civil Engineers](https://reader036.vdocuments.us/reader036/viewer/2022062315/568162ab550346895dd32d9d/html5/thumbnails/30.jpg)
USC
Since t1, t2 are both small, the term t1t2 should be small relative to t1+t2. Thus the magnitude of the error associated with one multiplication or division step should be t1+t2.
t1 ≤ (upper bound)
Although error of one calculation may not be significant, if 100 calculations were done, the error is then approximately 100. The magnitude of error associated with a calculation is directly proportional to the number of multiplication steps.
30
![Page 31: ECIV 201 Computational Methods for Civil Engineers](https://reader036.vdocuments.us/reader036/viewer/2022062315/568162ab550346895dd32d9d/html5/thumbnails/31.jpg)
USC
Overflow: Any number larger than the largest number that can be expressed on a computer will result in an overflow.
Underflow (Hole) : Any positive number smaller than the smallest number that can be represented on a computer will result an underflow.
Stable Algorithm: In extended calculations, it is likely that many round-offs will be made. Each of these plays the role of an input error for the remainder of the computation, impacting the eventual output. Algorithms for which the cumulative effect of all such errors are limited, so that a useful result is generated, are called “stable” algorithms. When accumulation is devastating and the solution is overwhelmed by the error, such algorithms are called unstable.
31
![Page 32: ECIV 201 Computational Methods for Civil Engineers](https://reader036.vdocuments.us/reader036/viewer/2022062315/568162ab550346895dd32d9d/html5/thumbnails/32.jpg)
USC
Figure 4.8
32