Conservative Confidence Bounds in Safety, from Generalised Claims of Improvement & Statistical Evidence
Salako, K. ORCID: 0000-0003-0394-7833, Strigini, L. ORCID: 0000-0002-4246-2866 & Zhao, X. (2021). Conservative Confidence Bounds in Safety, from Generalised Claims of Improvement & Statistical Evidence. In: 2021 51st Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN). The 51st Annual IEEE/IFIP International Conference on Dependable Systems and Networks, 21-24 Jun 2021, Taipei, Taiwan. doi: 10.1109/DSN48987.2021.00055
Abstract
“Proven-in-use”, “globally-at-least-equivalent”, “stress-tested”, are concepts that come up in diverse contexts in acceptance, certification or licensing of critical systems. Their common feature is that dependability claims for a system in a certain operational environment are supported, in part, by evidence – viz of successful operation – concerning different, though related, system[s] and/or environment[s], together with an auxiliary argument that the target system/environment offers the same, or improved, safety. We propose a formal probabilistic (Bayesian) organisation for these arguments. Through specific examples of evidence for the “improvement” argument above, we demonstrate scenarios in which formalising such arguments substantially increases confidence in the target system, and show why this is not always the case. Example scenarios concern vehicles and nuclear plants. Besides supporting stronger claims, the mathematical formalisation imposes precise statements of the bases for “improvement” claims: seemingly similar forms of prior beliefs are sometimes revealed to imply substantial differences in the claims they can support.
Publication Type: | Conference or Workshop Item (Paper) |
---|---|
Publisher Keywords: | Reliability claims, statistical testing, safetycritical systems, ultra-high reliability, conservative Bayesian inference, field testing, not worse than existing systems, software re-use, globally at least equivalent, proven in use |
Subjects: | H Social Sciences > HA Statistics Q Science > QA Mathematics Q Science > QA Mathematics > QA75 Electronic computers. Computer science |
Departments: | School of Science & Technology > Computer Science School of Science & Technology > Computer Science > Software Reliability |
Download (1MB) | Preview
Export
Downloads
Downloads per month over past year