City Research Online

Bohm, N., Ladkin, P. B., Littlewood, B. ORCID: 0000-0002-6397-8685 , Marshall, P., Mason, S., Newby, M., Murdoch, SJ, Thimbleby, H. & Thomas, M.view all authors (2022). Briefing Note: The legal rule that computers are presumed to be operating correctly – unforeseen and unjust consequences. Digital Evidence and Electronic Signature Law Review, 19, pp. 123-127. doi: 10.14296/deeslr.v19i0.5476

Littlewood, B. ORCID: 0000-0002-6397-8685 & Strigini, L. ORCID: 0000-0002-4246-2866 (2022). Letter to the Editor: A Critical Response to a Recent Paper by Daniels and Tudor. Safety-Critical Systems eJournal, 1(2),

Bohm, N., Christie, J., Ladkin, P. B. , Littlewood, B. ORCID: 0000-0002-6397-8685, Marshall, P., Mason, S., Newby, M., Murdoch, S., Thimbleby, H. & Thomas, M.view all authors (2022). The legal rule that computers are presumed to be operating correctly – unforeseen and unjust consequences. London, UK: Information Security Research & Education, University College London (UCL).

Marshall, P., Christie, J., Ladkin, B. , Littlewood, B. ORCID: 0000-0002-6397-8685, Mason, S., Newby, M., Rogers, J., Thimbleby, H. & Thomas, M.view all authors (2020). Recommendations for the probity of computer evidence. Digital Evidence and Electronic Signature Law Review, 18, pp. 18-26. doi: 10.14296/deeslr.v18i0.5240

Littlewood, B. ORCID: 0000-0002-6397-8685, Salako, K. ORCID: 0000-0003-0394-7833, Strigini, L. & Zhao, X.view all authors (2020). On Reliability Assessment When a Software-based System Is Replaced by a Thought-to-be-Better One. Reliability Engineering & System Safety, 197, article number 106752. doi: 10.1016/j.ress.2019.106752

Littlewood, B. ORCID: 0000-0002-6397-8685, Ladkin, P. B., Thimbleby, H. & Thomas, M.view all authors (2020). The Law Commission presumption concerning the dependability of computer evidence. Digital Evidence and Electronic Signature Law Review, 17, pp. 1-14. doi: 10.14296/deeslr.v17i0.5143

Zhao, X. ORCID: 0000-0002-3474-349X, Littlewood, B., Povyakalo, A. A. , Strigini, L. & Wright, D.view all authors (2018). Conservative Claims for the Probability of Perfection of a Software-based System Using Operational Experience of Previous Similar Systems. Reliability Engineering and System Safety, 175, pp. 265-282. doi: 10.1016/j.ress.2018.03.032

Zhao, X., Littlewood, B., Povyakalo, A. A. , Strigini, L. & Wright, D.view all authors (2017). Modeling the probability of failure on demand (pfd) of a 1-out-of-2 system in which one channel is “quasi-perfect”. Reliability Engineering & System Safety, 158, pp. 230-245. doi: 10.1016/j.ress.2016.09.002

Zhao, X., Littlewood, B., Povyakalo, A. A. & Wright, D.view all authors (2015). Conservative Claims about the Probability of Perfection of Software-based Systems. Paper presented at the The 26th IEEE International Symposium on Software Reliability Engineering, 02-11-2015 - 05-11-2015, Washington DC, USA.

Bishop, P. G., Bloomfield, R. E., Littlewood, B. , Popov, P. T., Povyakalo, A. A. & Strigini, L.view all authors (2014). A conservative bound for the probability of failure of a 1-out-of-2 protection system with one hardware-only and one software-based protection train. Reliability Engineering & System Safety, 130, pp. 61-68. doi: 10.1016/j.ress.2014.04.002

Rushby, J., Littlewood, B. & Strigini, L. (2014). Evaluating the Assessment of Software Fault-Freeness. Paper presented at the AESSCS 2014, 13-05-2015, Newcastle upon Tyne.

Littlewood, B. & Povyakalo, A. A. (2013). Conservative reasoning about epistemic uncertainty for the probability of failure on demand of a 1-out-of-2 software-based system in which one channel is “possibly perfect”. IEEE Transactions on Software Engineering, 39(11), pp. 1521-1530. doi: 10.1109/TSE.2013.35

Littlewood, B. & Povyakalo, A. A. (2013). Conservative bounds for the pfd of a 1-out-of-2 software-based system based on an assessor’s subjective probability of “not worse than independence”. IEEE Transactions on Software Engineering, 39(12), pp. 1641-1653. doi: 10.1109/TSE.2013.31

Littlewood, B. & Povyakalo, A. A. (2012). Conservative bounds for the pfd of a 1-out-of-2 software-based system based on an assessor’s subjective probability of "not worse than independence" (CSR Technical Report, 20 May 2012). London: Centre for Software Reliability, City University London.

Littlewood, B. & Povyakalo, A. A. (2012). Conservative reasoning about epistemic uncertainty for the probability of failure on demand of a 1-out-of-2 software-based system in which one channel is "possibly perfect" (CSR Technical Report 20 March 2012). London: Centre for Software Reliability, City University London.

Littlewood, B. & Rushby, J. (2011). Reasoning about the Reliability of Diverse Two-Channel Systems in which One Channel is "Possibly Perfect". IEEE Transactions on Software Engineering, 38(5), pp. 1178-1194. doi: 10.1109/TSE.2011.80

Bishop, P. G., Bloomfield, R. E., Littlewood, B. , Povyakalo, A. A. & Wright, D.view all authors (2011). Toward a Formalism for Conservative Claims about the Dependability of Software-Based Systems. IEEE Transactions on Software Engineering, 37(5), pp. 708-717. doi: 10.1109/tse.2010.67

Littlewood, B. & Strigini, L. (2011). "Validation of ultra-high dependability…" – 20 years on. Safety Systems, the Newsletter of the Safety-Critical Systems Club, 30(3),

Littlewood, B. & Burns, A. (2010). Reasoning About the Reliability of Multi-version, Diverse Real-Time Systems. Paper presented at the 31st IEEE Real-Time Systems Symposium, 30 November - 03 December 2010, San Diego, USA. doi: 10.1109/RTSS.2010.43

Littlewood, B. (2008). Comments on "Multi-objective genetic algorithm for solving N-version program design problem". Reliability Engineering & System Safety, 93(8), p. 1287. doi: 10.1016/j.ress.2007.06.005

Littlewood, B. (2007). Limits to dependability assurance - A controversy revisited. In: 29th International Conference on Software Engineering: ICSE 2007 Companion Volume, Proceedings. ICSE 2007, 20-26 May 2007, Minneapolis, USA. doi: 10.1109/ICSECOMPANION.2007.47

Bloomfield, R. E., Littlewood, B. & Wright, D. (2007). Confidence: Its role in dependability cases for risk assessment. In: 37TH ANNUAL IEEE/IFIP INTERNATIONAL CONFERENCE ON DEPENDABLE SYSTEMS AND NETWORKS, PROCEEDINGS. 37th Annual IEEE/IFIP International Conference on Dependable Systems and Networks, 25 - 28 June 2008, Edinburgh, UK. doi: 10.1109/DSN.2007.29

Bishop, P. G., Gashi, I., Littlewood, B. & Wright, D.view all authors (2007). Reliability modeling of a 1-out-of-2 system: Research with diverse Off-the-shelf SQL database servers. In: OConner, L (Ed.), ISSRE 2007: 18TH IEEE INTERNATIONAL SYMPOSIUM ON SOFTWARE RELIABILITY ENGINEERING, PROCEEDINGS. The 18th IEEE International Symposium on Software Reliability (ISSRE '07), 5 - 9 Nov 2007, Trollhättan, Sweden.

Littlewood, B. & Wright, D. (2007). The use of multilegged arguments to increase confidence in safety claims for software-based systems: A study based on a BBN analysis of an idealized example. IEEE Transactions on Software Engineering, 33(5), pp. 347-365. doi: 10.1109/tse.2007.1002

Littlewood, B. (2006). Comments on 'Evolutionary neural network modelling for software cumulative failure time prediction' by Liang Tian and Afzel Noore [Reliability Engineering and System Safety 87 (2005) 45-51]. Reliability Engineering & System Safety, 91(4), pp. 485-486. doi: 10.1016/j.ress.2005.02.001

Littlewood, B. & Bloomfield, R. E. (2004). On the use of diverse arguments to increase confidence in dependability claims. Paper presented at the International Conference on Control and Instrumentation in Nuclear Installations, 2004, Liverpool, UK.

Littlewood, B. & Strigini, L. (2004). Redundancy and diversity in security. In: Samarati, P, Ryan, P, Gollmann, D & Molva, Rview all authors (Eds.), COMPUTER SECURITY ESORICS 2004, PROCEEDINGS. 9th European Symposium on Research in Computer Security, Sept 2004, Sophia Antipolis, France.

Popov, P. T. & Littlewood, B. (2004). The effect of testing on reliability of fault-tolerant software. In: International Conference on Dependable Systems and Networks, 2004. 2004 International Conference on dependable systems and networks, 28 Jun - 1 Jul 2004, Florence, Italy. doi: 10.1109/DSN.2004.1311896

Littlewood, B., Bloomfield, R. E., Popov, P. T. , Povyakalo, A. A. & Strigini, L.view all authors (2004). The impact of "difficulty" variation on the probability of coincident failure of diverse systems. Paper presented at the International Conference on Control and Instrumentation in Nuclear Installations, 2004, Liverpool, UK.

Bishop, P. G., Bloomfield, R. E., Clement, T. , Guerra, S. & Jones, C.view all authors (2003). Integrity static analysis of COTS/SOUP. In: Anderson, S. O., Felici, M. & Littlewood, B. (Eds.), Knowledge-Based Intelligent Information and Engineering Systems 7th INternational Conference, KES 2003, Oxford, UK, September 2003. Proceedings, Part I. Lecture Notes in Computer Science, 2788. (pp. 63-76). London, UK: Springer. doi: 10.1007/b12002

Strigini, L., Bosio, D., Littlewood, B. & Newby, M. J.view all authors (2002). Advantages of open source processes for reliability: clarifying the issues. Paper presented at the Workshop on Open Source Software Development, Feb 2002, Newcastle upon Tyne, UK.

Littlewood, B., Popov, P. T. & Strigini, L. (2002). Assessing the reliability of diverse fault-tolerant software-based systems. Safety Science, 40(9), pp. 781-796. doi: 10.1016/s0925-7535(01)00084-4

Bloomfield, R. E., Courtois, P.-J., Littlewood, B. , Strigini, L., Yih, S. & Fan, C.-F.view all authors (2002). Search for the Unnecessary: Letter to the Editor. Nuclear Engineering International, 47(570), 11-.

Littlewood, B., Popov, P. T. & Strigini, L. (2001). Design diversity: an update from research on reliability modelling. In: Redmill, F & Anderson, T (Eds.), ASPECTS OF SAFETY MANAGEMENT. 9th Safety-critical Systems Symposium, 2001, Bristol, UK.

Littlewood, B., Popov, P. T. & Strigini, L. (2001). Modeling software design diversity. ACM Computer Surveys, 33(2), pp. 177-208. doi: 10.1145/384192.384195

Strigini, L., Popov, P. T. & Littlewood, B. (2000). Assessing the Reliability of Diverse Fault-Tolerant Systems. Paper presented at the INucE International Conference on Control and Instrumentation in Nuclear Installations, Bristol, UK.

Littlewood, B., Popov, P. T., Strigini, L. & Shryane, N.view all authors (2000). Modeling the effects of combining diverse software fault detection techniques. IEEE Transactions on Software Engineering, 26(12), pp. 1157-1167. doi: 10.1109/32.888629

Littlewood, B. & Strigini, L. (2000). Software reliability and dependability: a roadmap. In: Finkelstein, A (Ed.), The Future of Software Engineering. State of the Art Reports given at the 22nd Int. Conf. on Software Engineering. (pp. 177-188). ACM Press. doi: 10.1145/336512.336551

Strigini, L. & Littlewood, B. (2000). A discussion of practices for enhancing diversity in software designs. London, UK: Centre for Software Reliability, City University London.

Littlewood, B. (2000). The problems of assessing software reliability ...When you really need to depend on it. Paper presented at the Conference on Lessons in System Safety.

Littlewood, B. (2000). The use of proofs in diversity arguments. IEEE Transactions on Software Engineering, 26(10), pp. 1022-1023. doi: 10.1109/32.879822

Littlewood, B., Popov, P. T. & Strigini, L. (1999). A note on reliability estimation of functionally diverse systems. Reliability Engineering & System Safety, 66(1), pp. 93-95. doi: 10.1016/s0951-8320(99)00014-9

Frankl, P. G., Hamlet, R. G., Littlewood, B. & Strigini, L.view all authors (1998). Evaluating testing methods by delivered reliability. IEEE Transactions on Software Engineering, 24(8), pp. 586-601. doi: 10.1109/32.707695

Littlewood, B., Strigini, L., Wright, D. & Courtois, P.-J.view all authors (1998). Examination of Bayesian belief network for safety assessment of nuclear computer-based systems (70). Brussels: DeVa ESPRIT Long Term Research Project.

Littlewood, B., Bainbridge, I. & Bloomfield, R. E. (1998). The use of computers in safety-critical applications. London, UK: Health and Safety Commission.

Fenton, N., Littlewood, B., Neil, M. , Strigini, L., Wright, D. R. & Courtois, P.-J.view all authors (1997). Bayesian belief network model for the safety assessment of nuclear computer-based systems (52). Brussels: DeVa ESPRIT Long Term Research Project.

Frankl, P. G., Hamlet, D., Littlewood, B. & Strigini, L.view all authors (1997). Choosing a testing method to deliver reliability. In: PROCEEDINGS OF THE 1997 INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING. Software Engineering

Strigini, L. & Littlewood, B. (1997). Guidelines for Statistical Testing (PASCON/WO6-CCN2/TN12). ESA/ESTEC project PASCON.

Littlewood, B. & Wright, D. (1997). Some conservative stopping rules for the operational testing of safety-critical software. IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, 23(11), pp. 673-683. doi: 10.1109/32.637384

Littlewood, B. (1996). Evaluation of software dependability. In: Wand, I. C. & Milner, R. (Eds.), Computing Tomorrow: Future Research Directions in Computer Science. (pp. 198-216). New York, USA: Cambridge University Press.

Littlewood, B. & Wright, D. (1996). Reliability prediction of a software product using testing data from other products or execution environment (10). Brussels: DeVa Project.

Littlewood, B. & Wright, D. (1996). Some conservative stopping rules for the operational testing of saftey-critical software (33). Brussels: DeVa ESPRIT Long Term Research Project.

Littlewood, B. (1996). The impact of diversity upon common mode failures. Reliability Engineering & System Safety, 51(1), pp. 101-113. doi: 10.1016/0951-8320(95)00120-4

Littlewood, B. & Wright, D. (1995). A Bayesian model that combines disparate evidence for the quantitative assessment of system dependability. Paper presented at the 14th International Conference on Computer Safety (SafeComp’95), 11 - 13 October 1995, Belgirate, Italy.

Littlewood, B., Brocklehurst, S., Fenton, N. , Mellor, P., Page, S., Wright, D., Dobson, J., McDermid, J. & Gollmann, D.view all authors (1993). Towards operational measures of computer security. Journal of Computer Security, 2(2-3), pp. 211-229. doi: 10.3233/jcs-1993-22-308

Littlewood, B. & Strigini, L. (1993). Validation of Ultrahigh Dependability for Software-Based Systems. Communications of the ACM (CACM), 36(11), pp. 69-80. doi: 10.1145/163359.163373