City Research Online

Model risk – daring to open up the black box

Aggarwal, A., Beck, M. B., Cann, M., Ford, T., Georgescu, D., Morjaria, N., Smith, A., Taylor, Y., Tsanakas, A., Witts, L. and Ye, I. (2016). Model risk – daring to open up the black box. British Actuarial Journal, 21(2), pp. 229-296. doi: 10.1017/S1357321715000276

Abstract

With the increasing use of complex quantitative models in applications throughout the financial world, model risk has become a major concern. Such risk is generated by the potential inaccuracy and inappropriate use of models in business applications, which can lead to substantial financial losses and reputational damage. In this paper we deal with the management and measurement of model risk.

First, a model risk framework is developed, adapting concepts such as risk appetite, monitoring, and mitigation to the particular case of model risk. The usefulness of such a framework for preventing losses associated with model risk is demonstrated through case studies. Second, we investigate the ways in which different ways of using and perceiving models within an organisation both lead to different model risks. We identify four distinct model cultures and argue that in conditions of deep model uncertainty, each of those cultures makes a valuable contribution to model risk governance. Thus the space of legitimate challenges to models is expanded, such that, in addition to a technical critique, operational and commercial concerns are also addressed. Third, we discuss through the examples of proxy modelling, longevity risk and investment advice, common methods and challenges for quantifying model risk. Difficulties arise in mapping model errors to actual financial impact. In the case of irreducible model uncertainty, it is necessary to employ a variety of measurement approaches, based on statistical inference, fitting multiple models, and stress and scenario analysis.

Publication Type: Article
Publisher Keywords: Model; Model Risk; Model Error; Model Uncertainty; Risk Culture
Subjects: H Social Sciences > HB Economic Theory
H Social Sciences > HG Finance
Departments: Cass Business School > Actuarial Science & Insurance
URI: http://openaccess.city.ac.uk/id/eprint/14621
[img]
Preview
Text - Accepted Version
Download (706kB) | Preview

Export

Downloads

Downloads per month over past year

View more statistics

Actions (login required)

Admin Login Admin Login