Quantitative Storytelling in the Making of a Composite Indicator - Publication - Bridge of Knowledge

Search

Quantitative Storytelling in the Making of a Composite Indicator

Abstract

The reasons for and against composite indicators are briefly reviewed, as well as the available theories for their construction. After noting the strong normative dimension of these measures—which ultimately aim to ‘tell a story’, e.g. to promote the social discovery of a particular phenomenon, we inquire whether a less partisan use of a composite indicator can be proposed by allowing more latitude in the framing of its construction. We thus explore whether a composite indicator can be built to tell ‘more than one story’ and test this in practical contexts. These include measures used in convergence analysis in the field of cohesion policies and a recent case involving the World Bank’s Doing Business Index. Our experiments are built to imagine different constituencies and stakeholders who agree on the use of evidence and of statistical information while differing on the interpretation of what is relevant and vital.

Citations

  • 5 9

    CrossRef

  • 0

    Web of Science

  • 5 8

    Scopus

Authors (3)

Cite as

Full text

download paper
downloaded 40 times
Publication version
Accepted or Published Version
License
Creative Commons: CC-BY open in new tab

Keywords

Details

Category:
Articles
Type:
artykuły w czasopismach
Published in:
Social Indicators Research no. 149, pages 775 - 802,
ISSN: 0303-8300
Language:
English
Publication year:
2020
Bibliographic description:
Kuc-Czarnecka M., Piano, Lo S., Saltelli, A.: Quantitative Storytelling in the Making of a Composite Indicator// Social Indicators Research -Vol. 149, (2020), s.775-802
DOI:
Digital Object Identifier (open in new tab) 10.1007/s11205-020-02276-0
Bibliography: test
  1. Akerlof, G. A., & Shiller, R. J. (2015). Phishing for Phools. New Jersey: Princeton University Press.
  2. Anagnostou, A., Kallioras, D., & Kollias, Ch. (2015). Governance Convergence Among the EU28? Social Indicator Research, 129(1), 133-146. https ://doi.org/10.1007/s1120 5-015-1095-2. open in new tab
  3. Aparicio, J., & Kapelko, M. (2019). Enhancing the measurement of composite indicators of corporate social performance. Social Indicators Research, 144(2), 807-826. https ://doi.org/10.1007/s1120 5-018- 02052 -1. open in new tab
  4. Applebaum, A. (2017). A New European Narrative, New York Review of Books, 12 October. open in new tab
  5. Araújo, L., Saltelli, A., & Schnepf, S. V. (2017). Do PISA data justify PISA-based education policy? Inter- national Journal of Comparative Education and Development, 19(1), 1-17. https ://doi.org/10.1108/ IJCED -12-2016-0023. open in new tab
  6. Baddeley, M. (2006). Convergence or divergence? The impact of globalisation on growth and inequality in less developed countries. International Review of Applied Econometrics, 20(3), 391-410. https ://doi. org/10.1080/02692 17060 07362 50. open in new tab
  7. Balcerzak, A. P., & Pietrzak, M. B. (2017a). Digital economy in Visegrad countries. Multiple-criteria deci- sion analysis at regional level in the years 2012 and 2015. Journal of Competitiveness, 9(2), 5-18. https ://doi.org/10.7441/joc.2017.02.01. open in new tab
  8. Balcerzak, A. P., & Pietrzak, M. B. (2017b). Human development and quality of institutions in highly devel- oped countries. In M. H. Bilgin, H. Danis, E. Demir, & U. Can (Eds.), Financial environment and business development. Proceedings of the 16th Eurasia Business and Economics Society (pp. 231- 241). Berlin: Springer. https ://doi.org/10.1007/978-3-319-39919 -5. open in new tab
  9. Balcerzak, A. P., & Pietrzak, M. B. (2017c). Sustainable Development in the European Union in the years 2004-2013. In M. H. Bilgin and H. Danis, E. Demir, & U. Can (Eds.). Regional Studies on Economic Growth, Financial Economics and Management. Proceedings of the 19th Eurasia Business and Eco- nomics Society. Vol. 7, Springer, Berlin pp. 193-213. https ://doi.org/10.1007/978-3-319-54112 -9_12. open in new tab
  10. Balcerzak, A. P. & Rogalska, E. (2016). Non-Keynesian Effects of Fiscal Consolidations in Central Europe in the Years 2000-2013. In M. H. Bilgin & H. Danis (Eds.), Entrepreneurship, Business and Econom- ics. Proceedings of the 15th Eurasia Business and Economics Society, Vol. 2 (pp. 271-282). Berlin: Springer. https ://doi.org/10.1007/978-3-319-27573 -4_18. open in new tab
  11. Barrington-Leigh, C., & Escande, A. (2018). Measuring progress and well-being: A comparative review of indicators. Social Indicators Research, 135(3), 893-925. https ://doi.org/10.1007/s1120 5-016-1505-0. open in new tab
  12. Barro, R. J., & Sala-i-Martin, X. (1999). Economic Growth. Cambridge: MIT Press. open in new tab
  13. Bartkowiak-Bakun, N. (2017). The Diversity of socioeconomic development of rural areas in poland in the western borderland and the problem of post-state farm localities. Oeconomia Copernicana, 8(3), 417-431. https ://doi.org/10.24136 /oc.v8i3.26. open in new tab
  14. Beck, P.U. (1992 [1986]). Risk society: Towards a new modernity. Sage Publications, Thousand Oaks.
  15. Becker, W., Paruolo, P., Saisana, M., & Saltelli, A. (2017). Weights and importance in composite indicators: Mind the gap, In R. Ghanem, D. Higdon, H. Owhadi (Eds.), Handbook of Uncertainty Quantification, pp. 1187-1216, Berlin: Springer. https ://doi.org/10.1007/978-3-319-12385 -1. open in new tab
  16. Benjamin, P., Bhorat, H., & Cheadle, H. (2010). The cost of "doing business" and labour regulation: The case of South Africa. International Labour Review, 149(1), 73-91. https ://doi.org/10.1111/j.1564- 913X.2010.00076 .x. open in new tab
  17. Berg, J., & Cazes, S. (2007). The doing business indicators: Measurement issues and political implications. Geneva: International Labour Office. open in new tab
  18. Beycan, T., Vani, B. P., & Bruggemann, R. (2019). Ranking Karnataka districts by the multidimensional poverty index (MPI) and by applying simple elements of partial order theory. Social Indicators Research, 143, 173-200. https ://doi.org/10.1007/s1120 5-018-1966-4. open in new tab
  19. Boden, R., & Epstein, D. (2006). Managing the research imagination? Globalisation and Research in Higher Education, Globalisation, Societies and Education, 4(2), 223-236. https ://doi.org/10.1080/14767 72060 07526 19. open in new tab
  20. Boulanger, P.-M. (2014). Elements for a comprehensive assessment of public indicators, Report EUR 26921 EN. Retrieved January 20, 2020 from http://publi catio ns.jrc.ec.europ a.eu/repos itory /bitst ream/JRC92 162/lbna2 6921e nn.pdf. open in new tab
  21. Boulanger, P.-M. (2018). A systems-theoretical perspective on sustainable development and indicators. In S. Bell & S. Morse (Eds.), The Routledge handbook of sustainability indicators. London: Taylor & Francis. https ://doi.org/10.4324/97813 15561 103. open in new tab
  22. Boyle, G. & McCarthy, T. (1997). Simple measures of convergence in per capita GDP: A Note on Some Further International Evidence, Economics, Finance and Accounting Department Working Paper Series n751197, Department of Economics, Finance and Accounting, National University of Ireland -Maynooth. open in new tab
  23. Bruno, I., Didier, E. & Prévieux, J. (2014). Stat-activisme. Comment lutter avec des nombres. Paris: Zones, La Découverte. open in new tab
  24. Capecchi, S., & Simone, R. (2019). A Proposal for a model-based composite indicator: Experience on per- ceived discrimination in Europe. Social Indicators Research, 141(1), 95-110. https ://doi.org/10.1007/ s1120 5-018-1848-9. open in new tab
  25. Carlsen, L., & Bruggemann, R. (2014). The 'Failed State Index' offers more than just a simple ranking. Social Indicators Research, 115, 525-530. https ://doi.org/10.1007/s1120 5-012-9999-6. open in new tab
  26. Carlsen, L., & Bruggemann, R. (2017). Fragile state index: Trends and developments. A partial order data analysis. Social Indicators Research, 133, 1-14. https ://doi.org/10.1007/s1120 5-016-1353-y. open in new tab
  27. Carrozza, C. (2014). Democratizing expertise and environmental governance: Different approaches to the politics of science and their relevance for policy analysis. Journal of Environmental Policy & Planning, 17, 108-126. https ://doi.org/10.1080/15239 08X.2014.91489 4. open in new tab
  28. Chaaban, J., Irani, A., & Khoury, A. (2016). The composite global well-being index (CGWBI): A new multi-dimensional measure of human development. Social Indicators Research, 129(1), 465-487. https ://doi.org/10.1007/s1120 5-015-1112-5. open in new tab
  29. Cheba, K., & Szopik-Depczyńska, K. (2017). Multidimensional comparative analysis of the competitive capacity of the European Union countries and geographical regions. Oeconomia Copernicana, 8(4), 487-504. https ://doi.org/10.24136 /oc.v8i4.30. open in new tab
  30. Commission, European. (2014). Employment and social developments in Europe 2014. Luxemburg: Publication Office of the European Union. open in new tab
  31. Commission, European. (2016). Employment and social developments in Europe: Annual review 2016. Luxemburg: Publication Office of the European Union.
  32. Cosci, S., & Mirra, L. (2017). A spatial analysis of growth and convergence in Italian provinces: the role of infrastructure. Regional Studies. https ://doi.org/10.1080/00343 404.2017.13341 17. open in new tab
  33. Dewey, J. (1938). The public and its problems. Redditch: Read Book Ltd. Edition.
  34. Dinis, G., Costa, C., & Pacheco, O. (2019). Composite indicator for measuring the world interest by Por- tugal's tourism. Journal of Spatial and Organizational Dynamics, 1(7), 9-52. open in new tab
  35. Dutta S., Lanvin B., & Wunsch-Vincent S. (Eds.) (2018). Global innovation index 2018. Energizing the world with innovation 11th edition. Cornell University, INSEAD, and WIP. Ithaca, Fontainebleau, and Geneva.
  36. Eurofound. (2018). Upward convergence in the EU: Concepts, measurements and indicators. Luxem- bourg: Publications Office of the European Union. open in new tab
  37. European Commission (2015). Speaking points by Employment, Social Affairs and Labour Mobility Commissioner Marianne Thyssen at the press conference to launch the 2016 European Semester, speech, Brussels, 26 November 2015. open in new tab
  38. European Commission (2017a). Assessment of the 2017 convergence programme for Czech Republic. European Commission. Retrieved October 1, 2017, from https ://ec.europ a.eu/info/sites /info/files /03_cz_cp_asses sment .pdf. open in new tab
  39. European Commission (2017b). Assessment of the 2017 convergence programme for Hungary. Euro- pean Commission. Retrieved October 1, 2017, from https ://ec.europ a.eu/info/sites /info/files /17_ hu_cp_asses sment .pdf. open in new tab
  40. European Commission (2017c). Assessment of the 2017 convergence programme for Poland. European Commission. Retrieved October 1, 2017, from https ://ec.europ a.eu/info/sites /info/files /21_pl_cp_ asses sment .pdf. open in new tab
  41. European Commission (2017d). Assessment of the 2017 convergence programme for The United King- dom. European Commission. Retrieved October 1, 2017, from https ://ec.europ a.eu/info/sites /info/ files /28_uk_cp_asses sment .pdf. open in new tab
  42. European Commission (2017e). Commission Recommendation of 26.4.2017 on the European Pillar of Social Rights. Retrieved October 1, 2017, https ://ec.europ a.eu/commi ssion /publi catio ns/commi ssion -recom menda tion-estab lishi ng-europ ean-pilla r-socia l-right s_pl. open in new tab
  43. Flood, A. (2016). 'Post-truth' named word of the year by Oxford Dictionaries. The Guardian, 15. Funtowicz, S. O., & Ravetz, J. R. (1990). Uncertainty and quality in science for policy. Dordrecht: Klu- wer Academic.
  44. Funtowicz, S. O., & Ravetz, J. R. (1993). Science for the Post-Normal Age. Futures, 25, 739-755. https ://doi.org/10.1016/0016-3287(93)90022 -L. open in new tab
  45. Funtowicz, S. O., & Ravetz, J. R. (1994). The worth of a songbird: Ecological economics as a post- normal science. Ecological Economics, 10, 197-207. open in new tab
  46. Furkowa, A., & Chocholata, M. (2017). Interregional R and D spillovers and regional convergence: A spatial econometric evidence from the EU regions. Equilibrium. Quarterly Journal of Economics and Economic Policy, 12(1), 9-24. https ://doi.org/10.24136 /eq.v12i1 .1. open in new tab
  47. Giampietro, M., Aspinall, R. J., Ramos-Martin, J., & Bukkens, S. G. F. (2014). Resource accounting for sustainability assessment: The nexus between energy, food, water and land use. Milton Park: Taylor & Francis. open in new tab
  48. Gluckman, P. (2017). Can science and science advice be effective bastions against the post-truth dynamic? Speech delivered at University College London. Retreived 1 October 8 from, www.pmcsa .org.nz/wp- conte nt/uploa ds/17-10-18-UCL-speec h.pdf. open in new tab
  49. Greyling, T., & Tregenna, F. (2017). Construction and analysis of a composite quality of life index for a region of South Africa. Social Indicators Research, 131(3), 887-930. https ://doi.org/10.1007/s1120 5-016-1294-5. open in new tab
  50. Hausken, K., & Moxnes, J. F. (2019). Innovation, development and national indices. Social Indicators Research, 141(3), 1165-1188. https ://doi.org/10.1007/s1120 5-018-1873-8. open in new tab
  51. Heichel, S., Pape, J., & Sommerer, T. (2005). Is there convergence in convergence research? An overview of empirical studies on policy convergence. Journal of European Public Policy, 12(5), 817-840. https :// doi.org/10.1080/13501 76050 01614 31. open in new tab
  52. Holzinger, K., Knill, C., & Sommerer, T. (2011). Is there convergence of national environmental policies? An analysis of policy outputs in 24 OECD Countries. Environmental Politics, 20(1), 20-41. https :// doi.org/10.1080/09644 016.2011.53816 3. open in new tab
  53. Horridge, M., & Rokicki, B. (2017). The impact of European Union Accession on regional income con- vergence within the Visegrad countries. Regional Studies, 52(4), 1-13. https ://doi.org/10.1080/00343 404.2017.13335 93. open in new tab
  54. Høyland, B., Moene, K., & Willumsen, F. (2012). The tyranny of international index rankings. Journal of Development Economics, 97(1), 1-14. https ://doi.org/10.1016/j.jdeve co.2011.01.007. open in new tab
  55. James, G., Witten, G., Hastie, T., & Tibshirani, R. (2017). An introduction to statistical learning. Berlin: Springer. open in new tab
  56. Kahan, D. M., Wittlin, M., Peters, E., Slovic, P., Ouellette, L.L., Braman, D. & Mandel, G. N. (2011). The tragedy of the risk-perception commons: Culture conflict, rationality conflict, and climate change. Temple University Legal Studies Research Paper No. 2011-2026, DOI: 10.2139/ssrn.1871503. open in new tab
  57. Kendall, M. G. (1938). A new measure of rank correlation. Biometrika, 30(1-2), 81-93. https ://doi. org/10.1093/biome t/30.1-2.81. open in new tab
  58. Kong, J., Philips, C. B., & Sul, D. (2019). Weak sigma-convergence: Theory and applications. Journal of Econometrics, 209(2), 185-207. https ://doi.org/10.1016/j.jecon om.2018.12.022. open in new tab
  59. Kruk, H., & Waśniewska, A. (2017). Application of the Perkal method for assessing competitiveness of the countries of Central and Eastern Europe. Oeconomia Copernicana, 8(3), 337-352. https ://doi. org/10.24136 /oc.v8i3.21. open in new tab
  60. Kuc, M. (2017). Social convergence in Nordic countries at regional level. Equilibrium. Quarterly Journal of Economics and Economic Policy, 12(1), 25-41. https ://doi.org/10.24136 /eq.v12i1 .2. open in new tab
  61. Lakoff, G. (2004). Don't think of an elephant: Know your values and frame the debate. White River Junc- tion: Chelsea Green Publishing.
  62. Lakoff, G. (2010). Why it matters how we frame the environment. Environmental Communication: A Jour- nal of Nature and Culture, 4(1), 70-81. https ://doi.org/10.1080/17524 03090 35297 49. open in new tab
  63. Lawder, D., & Wroughton, L. (2018). World Bank economist Paul Romer quits after Chile comments. Reu- ters. Retrieved 20 Jan, 2020 from https ://www.reute rs.com/artic le/us-world bank-econo mist-romer -idUSK BN1FD 38Y. open in new tab
  64. Luzzati, T., & Gucciardi, G. (2015). A non-simplistic approach to composite indicators and rankings: An illustration by comparing the sustainability of the EU countries. Ecological Economics, 113, 25-38. https ://doi.org/10.1016/j.ecole con.2015.02.018. open in new tab
  65. Małkowska, A., & Głuszak, M. (2016). Pro-Investment local policies in the area of real estate econom- ics: Similarities and differences in the strategies used by communes. Oeconomia Copernicana, 7(2), 269-283. https ://doi.org/10.12775 /OeC.2016.016. open in new tab
  66. Mann, J., & Shideler, D. (2015). Measuring Schumpeterian Activity Using a Composite Indicator. Journal of Entrepreneurship and Public Policy, 4(1), 57-84. https ://doi.org/10.1108/JEPP-07-2013-0029. open in new tab
  67. Marozzi, M. (2015). Measuring trust in European Public Institutions. Social Indicators Research, 123(3), 879-895. https ://doi.org/10.1007/s1120 5-014-0765-9. open in new tab
  68. Marris, C., Wynne, B., Simmons, P., & Weldon, S. (2001). Public Perceptions of Agricultural Biotechnolo- gies in Europe. Final Report of the PABE research project funded by the Commission of European Communities Contract number: FAIR CT98-3844 (DG12 -SSMI).
  69. Mazziotta, M., & Pareto, A. (2016). On a generalized non-compensatory composite index for measuring socio-economic phenomena. Social Indicators Research, 127(3), 983-1003. https ://doi.org/10.1007/ s1120 5-015-0998-2. open in new tab
  70. Merton, R. K. (1973[1942]). The normative structure of science. In R. K. Merton (Ed.), The sociology of science: Theoretical and empirical investigations (pp. 267-280). Chicago: University of Chicago Press.
  71. Meyer, H.-D. & Zahedi, K. (2014) An open letter: To Andreas Schleicher, OECD, Paris, Global Policy Institute, 5 May, and Guardian, 6 May. open in new tab
  72. Michener, G. (2015). Policy Evaluation via composite indexes: qualitative lessons from International Transpar- ency Policy Indexes. World Development, 74, 184-196. https ://doi.org/10.1016/j.world dev.2015.04.016. open in new tab
  73. Miro, D. R., & Piffaut, P. V. (2019). Financial quality index (ICF). Cuadernos de Economia: Spain, 119(42), 189-206. https ://doi.org/10.32826 /cude.v42i1 19.170. open in new tab
  74. Mirowski, P. (2013). Never Let a Serious Crisis Go Wasted. Verso Books.
  75. Muller, J. Z. (2018). The tyranny of metrics. Princeton: Princeton University Press.
  76. OECD-JRC (2008). Handbook on constructing composite indicators: Methodology and user guide, OECD Sta- tistics working paper JT00188147, STD/DOC(2005)3. open in new tab
  77. Paruolo, P., Saisana, A., & Saltelli, A. (2013). Ratings and rankings: Voodoo or science? Journal Royal Statisti- cal Society A, 176(3), 609-634. https ://doi.org/10.1111/j.1467-985X.2012.01059 .x. open in new tab
  78. Pawełek, B. (2008). Normalisation of variables methods in comparative research on complex economic phe- nomena. Cracow: Zeszyty Naukowe Uniwersytet Ekonomicznego w Krakowie.
  79. Peiro-Palomino, J., & Picazo-Tadeo, A. J. (2018). OECD: One or many? ranking countries with a compos- ite well-being indicator. Social Indicators Research, 139(3), 847-869. https ://doi.org/10.1007/s1120 5-017-1747-5. open in new tab
  80. Pielke, R. A., Jr. (2007). The honest broker. Cambridge: Cambridge University Press.
  81. Pietrzak, M. B., & Balcerzak, A. P. (2017). A regional scale analysis of economic convergence in Poland in the Years 2004-2012. In M. H. Bilgin‫ת‬ H. Danis, E. Demir, & U. Can (Eds.), Regional studies on economic growth, financial economics and management. Proceedings of the 19th Eurasia Business and Economics Society. Vol. 7 (pp. 257-268). Berlin: Springer. https ://doi.org/10.1007/978-3-319-54112 -9_16. open in new tab
  82. Pinheiro-Alves, R., & Zambujal-Oliveira, J. (2012). the ease of doing business index as a tool for investment location decisions. Economics Letters, 117(1), 66-70. https ://doi.org/10.1016/j.econl et.2012.04.026. open in new tab
  83. Popp Berman, E., & Hirschman, D. (2018). The sociology of quantification: Where are we now? Contemporary Sociology. A Journal of Reviews., 47(3), 257-266. https ://doi.org/10.1177/00943 06118 76764 9. open in new tab
  84. Próchniak, M., & Witkowski, B. (2016). On the use of panel stationarity tests in convergence analysis: empiri- cal evidence for the EU Countries. Equilibrium. Quarterly Journal of Economics and Economic Policy, 11(1), 77-96. https ://doi.org/10.12775 /equil .2016.004. open in new tab
  85. Ravallion, M. (2010). Mashup indices of development, Policy Research Working Paper 5432, World Bank Development Research Group. Retrieved 20 Jan, 2020 form http://docum ents.world bank.org/curat ed/ en/45479 14683 29342 000/pdf/WPS54 32.pdf. open in new tab
  86. Ravetz, J. R. (1987). Usable knowledge, Usable Ignorance. Knowledge, 9(1), 87-116. https ://doi. org/10.1177/10755 47087 00900 104. open in new tab
  87. Rayner, S. (2012). Uncomfortable knowledge: The social construction of ignorance in science and envi- ronmental policy discourses. Economy and Society, 41(1), 107-125. https ://doi.org/10.1080/03085 147.2011.63733 5. open in new tab
  88. Reinert, E.S. (2008). How Rich Countries Got Rich… and Why Poor Countries Stay Poor, Public Affairs.
  89. Renner, A., & Giampietro, M. (2019). Socio-technical discourses of European electricity decarbonization: Con- testing narrative credibility and legitimacy with quantitative story-telling. Energy Research & Social Sci- ence. https ://doi.org/10.1016/j.erss.2019.10127 9. open in new tab
  90. Rethinking economics. (2017). 33 Theses for an Economics Reformation. Retrieved 20 Jan , 2020 from http:// www.rethi nkeco nomic s.org/journ al/time-econo mics-refor matio n/. open in new tab
  91. Rogalska, E. (2018). Multiple-criteria analysis of regional entrepreneurship conditions in Poland. Equilib- rium Quarterly Journal of Economics and Economic Policy, 13(4), 707-723. https ://doi.org/10.24136 / eq.2018.034. open in new tab
  92. Romer, P. M. (2015). Mathiness in the theory of economic growth. American Economic Review, 105, 89-93. https ://doi.org/10.1257/aer.p2015 1066. open in new tab
  93. Romer, P. (2018a)., Doing Business. Retrieved 23 November 2019 from, https ://paulr omer.net/doing -busin ess/. open in new tab
  94. Romer, P. (2018b). Comments about the doing business report. Retrieved 23 November 2019 from, https ://paulr omer.net/my-uncle ar-comme nts-about -the-doing -busin ess-repor t/ . open in new tab
  95. Saisana, M., D'Hombres, B., & Saltelli, A. (2011). Rickety numbers: Volatility of university rankings and pol- icy implications. Research Policy, 40, 165-177. https ://doi.org/10.1016/j.respo l.2010.09.003. open in new tab
  96. Saisana, M., Saltelli, A., & Tarantola, S. (2005). Uncertainty and sensitivity analysis techniques as tools for the quality assessment of composite indicators. Journal of the Royal Statistical Society, A, 168(2), 307-323. https ://doi.org/10.1111/j.1467-985X.2005.00350 .x. open in new tab
  97. Saltelli, A. (2017). International PISA tests show how evidence-based policy can go wrong. The Conversation, June 12. open in new tab
  98. Saltelli, A. (2018). Why science's crisis should not become a political battling ground. Futures, 104, 85-90. https ://doi.org/10.1016/j.futur es.2018.07.006. open in new tab
  99. Saltelli, A. (2019). Statistical versus mathematical modelling: a short comment. Nature Communications, 10, 1-3. open in new tab
  100. Saltelli, A. (2020). Ethics of quantification or quantification of ethics. Futures. https ://doi.org/10.1016/j. futur es.2019.10250 9. open in new tab
  101. Saltelli, A., & Funtowicz, S. O. (2017). To Tackle the Post-Truth World, Science Must Reform Itself, TheCon- versation.com, 27 January. open in new tab
  102. Saltelli, A., & Giampietro, M. (2017). What Is wrong with evidence based policy, and how can it be improved? Futures, 91, 62-71. https ://doi.org/10.1016/j.futur es.2016.11.012. open in new tab
  103. Saltelli, A., Guimarães Pereira, Â., Van der Sluijs, J.P. & Funtowicz, S. O. (2013). What do i make of your lati- norum? Sensitivity auditing of mathematical modelling. International Journal of Foresight and Innova- tion Policy, 9 (2/3/4), 213-234. https ://doi.org/10.1504/ijfip .2013.05861 0. open in new tab
  104. Saltelli, A., Ratto, M., Andres, T., Campolongo, F., Cariboni, J., Gatelli, D., et al. (2008). Global sensitivity analysis: The Primer. Hoboken: Wiley. open in new tab
  105. Scheurer, L., & Haase, A. (2017). Diversity and Social Cohesion in European Cities: Making Sense of Today's European Union-Urban Nexus within Cohesion Policy. European Urban and Regional Studies. https :// doi.org/10.1177/09697 76417 73609 9. open in new tab
  106. Schueth, S. (2011). Assembling International Competitiveness: The Republic of Georgia, USAID, and the Doing Business Project: ECONOMIC GEOGRAPHY. Economic Geography, 87(1), 51-77. https ://doi. org/10.1111/j.1944-8287.2010.01103 .x. open in new tab
  107. Schwab, K. (Ed.). (2019). The global competitiveness report 2019. Geneva: World Economic Forum. open in new tab
  108. Semenenko, I., Halhash, R., & Sieriebriak, K. (2019). Sustainable development of regions in Ukraine: before and after the beginning of the conflict. Equilibrium Quarterly Journal of Economics and Economic Pol- icy, 14(2), 317-339. https ://doi.org/10.24136 /eq.2019.015. open in new tab
  109. Stanickova, M. (2017). Can the implementation of the Europe 2020 strategy goals be efficient? The challenge for achieving social equality in the European Union. Equilibrium: Quarterly Journal of Economics and Economic Policy, 12(3), 383-398. https ://doi.org/10.24136 /eq.v12i3 .20. open in new tab
  110. Stiglitz, J., Sen, A., & Fitoussi, J.-P. (2009). Report by the Commission on the Measurement of Economic Per- formance and Social Progress. Retreived June 2017 from, http://ec.europ a.eu/euros tat/docum ents/11802 5/11812 3/Fitou ssi+Commi ssion +repor t. open in new tab
  111. Strassheim, H., & Kettunen, P. (2014). When does evidence-based policy turn into policy-based evidence? Con- figurations, contexts and mechanisms. Evidence & Policy: A Journal of Research, Debate and Practice, 10(2), 259-277. https ://doi.org/10.1332/17442 6514X 13990 43399 1320. open in new tab
  112. Supiot, A. (2015). Governance by numbers: The making of a legal model of allegiance. Oxford: Oxford Univer- sity Press. open in new tab
  113. Talley, I. (2018). World Bank unfairly influenced its own competitiveness rankings, The Wall Street Journal. Retrieved 20 Jan , 2020 from https ://www.wsj.com/artic les/world -bank-unfai rly-influ enced -its-own- compe titiv eness -ranki ngs-15157 97620 . open in new tab
  114. Tsionas, E. G. (2002). Another look at regional convergence in Greece. Regional Studies, 36(6), 603-609. https ://doi.org/10.1080/00343 40022 01467 59. open in new tab
  115. van der Sluijs, J. P., Craye, M., Funtowicz, S., Kloprogge, P., Ravetz, J., & Risbey, J. (2005). Combining quan- titative and qualitative measures of uncertainty in model-based environmental assessment: The NUSAP system. Risk Analysis, 25(2), 481-492. https ://doi.org/10.1111/j.1539-6924.2005.00604 .x. van der Sluijs, J., Petersen, A. C., Janssen, P. H. M., Risbey, J. S., & Ravetz, J. R. (2008). Exploring the quality of evidence for complex and contested policy decisions. Environmental Research Letters, 3(2), 024002. https ://doi.org/10.1088/1748-9326/3/2/02400 8. open in new tab
  116. Wilsdon, J. (2016). The metric tide: The independent review of the role of metrics in research assessment and management. Thousand Oaks: Sage Publications. open in new tab
  117. Woessmann, L. (2014). The Economic Case for Education. Institute and University of Munich. European Expert Network on Economics of Education (EENEE). EENEE Analytical Report 20. open in new tab
  118. World Bank (2019). Doing Business. (2019). Training for reform (2019). Washington: International Bank for Reconstruction and Development. open in new tab
  119. Żelazny, R., & Pietrucha, J. (2017). Measuring innovation and institution: The creative economy index. Equi- librium: Quarterly Journal of Economics and Economic Policy, 12(1), 43-62. https ://doi.org/10.24136 / eq.v12i1 .3. open in new tab
  120. Zumbrun, J. (2018). World Bank Chief Economist Paul Romer Resigns. Wall Street Journal. Retrieved 20 Jan, 2020 from https ://www.wsj.com/artic les/world -bank-chief -econo mist-paul-romer -resig ns-15168 23370 . open in new tab
  121. Publisher's Note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations. open in new tab
Verified by:
Gdańsk University of Technology

seen 108 times

Recommended for you

Meta Tags