DiscoverIEE 475: Simulating Stochastic SystemsLecture H (2024-10-29): Verification, Validation, and Calibration of Simulation Models
Lecture H (2024-10-29): Verification, Validation, and Calibration of Simulation Models

Lecture H (2024-10-29): Verification, Validation, and Calibration of Simulation Models

Update: 2024-10-30
Share

Description

During this lecture slot, we start with slides from Lecture G3 (on goodness of fit) that were missed during the previous lecture due to timing. In particular, we review hypothesis testing fundamentals (type-I error, type-II error, statistical power, sensitivity, false positive rate, true negative rate, receiver operating characteristic, ROC, alpha, beta) and then go into examples of using Chi-squared and Kolmogorov–Smirnov tests for goodness of fit for arbitrary distributions. We also introduce Anderson–Darling (for flexibility and higher power) and Shapiro–Wilk (for high-powered normality testing).

We close with where we originally intended to start – with definitions of testing, verification, validation, and calibration. We will pick up from here next time.

<iframe allowfullscreen="" class="BLOG_video_class" height="266" src="https://www.youtube.com/embed/U2LpVVaj2Z0" width="320" youtube-src-id="U2LpVVaj2Z0"></iframe>


Comments 
In Channel
loading
00:00
00:00
x

0.5x

0.8x

1.0x

1.25x

1.5x

2.0x

3.0x

Sleep Timer

Off

End of Episode

5 Minutes

10 Minutes

15 Minutes

30 Minutes

45 Minutes

60 Minutes

120 Minutes

Lecture H (2024-10-29): Verification, Validation, and Calibration of Simulation Models

Lecture H (2024-10-29): Verification, Validation, and Calibration of Simulation Models

Theodore P. Pavlic