Call for papers “Impact Measurement of the Social and Solidarity Economy”

Guest Editors

- Marie J. Bouchard, Full Professor, Université du Québec à Montréal, Presidentof the International Scientific Commission on Social and Cooperative Economy of CIRIEC

- Damien Rousselière, Full Professor, AGROCAMPUS OUEST, France

Is the proof in the pudding? Measuring the impacts of social and solidarity economy. Why? When? How?

The interest in impact measurement of the social and solidarity economy (SSE) is reaffirmed year upon year. Each organization, at some time or another in its development, will come to ask itself about the effects that it generates in order to improve its efficiency and the efficacy of its actions, but also to enhance its recognition among the external stakeholders. Moreover, the financial backers - whether public, philanthropic or private – also express their desire to better know how their financial support contributes to solving or resorbing problems. This renewed interest manifests itself in requirements of demonstration for which SSE organizations often feel poorly of inadequately equipped. This special edition of the journal wants to focus on the issues of impact measurement in the SSE.

Evaluation of the SSE is not a new affair
Evaluation in the SSE is not a new affair. In fact, organisations of the SSE are well accustomed to it (Bouchard, Bourque & Lévesque 2000). A CIRIEC working group reviewed the evaluation practices of organizations and sectors of the SSE from an international perspective (Bouchard 2009). Results showed that evaluation modalities vary considerably, serving various purposes, either to meet funder's expectations, improve practices through formative evaluation, or produce social balance sheets to mobilize stakeholders and increase legitimacy. Practices range from accountability centred on objectives of results determined a priori (as is the case for government programmes), to voluntary disclosure centred on responsible social or environmental practices (cooperative balance, societal balance, social audit). Certain sectors of the SSE have measured their economic impact (cost-benefit analysis, intersectoral input-output model, avoided social costs, expanded value added statement), their social impact (health and welfare of the population), or environmental impact (carbon footprint, product life-cycles). Important observations are that evaluation has become an mandatory function of management, but more crucially that it plays an implicit role in the governance of organizations.

New societal and environmental challenges, new financial players
The concern about severe and persistent social and environmental problems (growing inequalities, unsustainable development, climate change, etc.) has increased and become global, as shown by the 2030 United Nations Sustainable Development Agenda. Calls are being heard for a better assessment of the solutions brought to help curbing them. In this context, evaluation becomes a strategic issue.

Now, the rise of the current of social investment over the past decade has changed the picture. The term "measurement" has become more and more frequently used, alongside terms such as "evidence", "scaling" and "impact". At the heart of the model is the need felt by the financial backers, whether public or charitable, beyond mere accountability, to "see" the effects of their
action. In particular, we see a new generation of initiatives and impact measurement indicators focused on the needs of the financial world with regards to social or environemental responsibility: Impact Reporting and Investments Standards (IRIS), Social Return on Investment (SROI), Global Impact Investing Ratings System (GIIRS) supported by the B-Lab, Measurement and monitoring of the social impact of investments in France (MESIS). The current of social finance goes farther, in seeking to mobilise venture capital to generate a return both social and financial. This model presumes a better effectiveness of social services through the injection of private capital and by the obligation of demonstration of results, as can be seen with the contracts of social impact bonds (SIB). While the demonstration has not been made (Maier & Meyer 2017; McHugh et al. 2013), the craze for this type of approach nevertheless spreads very quickly.

Consequences for the social an solidarity economy
Around one hundred different approaches, tools and methods can be identified for social impact measurement as conceived for social investment (Salathé-Beaulieu et al. 2019). The diversity and fragmentation of these initiatives is seen as a common problem for the organisations of the SSE and for their financial backers. Various views on the role of the SSE offer many different angles from which to appreciate its performance (Carman 2011, Gadrey 2005). As a consequence, various perspectives can lead to contradictory views about what should be evaluated, who should evaluate, when, what for and for whom (Nicholls 2018).

This new context puts pressure on the SSE. On the one hand, the institutional setting (new public management, evidence-based policies, pay-for-performance schemes) and the accentuation of market regulation (competition for niches but also for subsidies and public contracts) increase the importance of demonstrating efficiency and accounting for responsible management of resources. On the other hand, philanthropic capitalism requires to demonstrate impacts as it is at the heart of its remuneration scheme. With this, we are moving away from a culture of redistribution and towards that of social finance. This has important consequences for the practices and public policies regarding SSE.

The SSE can be seen as an important player in finding lasting solutions on a number of the sustainable development goals at different scales (Brown et al. 2015; Chaves & Monzon 2012, Duguid 2017; Hudon & Huybrechts 2017; Noya & Clarence 2007; Seyfang & Smith 2007; Vézina, Malo & Ben Selma 2017). Many case studies have exposed the contribution of SSE organizations in various national settings (see COPAC, ILO and UNRISD1). It remains to be seen how to move from promises to measurable evidence. The craze for impact measurement can however prove to be demanding for SSE organizations, as it requires additional resources to manage evaluation expectations. The ability of organizations to cope with the demands of evaluation varies greatly (Carman & Fredericks 2010). Approaches are more or less well adapted to the SSE (Besançon & Chochoy 2019, Liket et al. 2014), some can be subject to controversy (Cupitt 2015, Mertens, Xhauflair & Marée 2015). For example, standardized assessment methods and indicators are said to be poorly suited to the SSE, given the variety of its forms and the numerous sectors of activity where it is present (GECES 2014), which may even lead stakeholders to refuse to submit to it (TIESS 2019).

This vogue for evaluation can nevertheless represent an opportunity for the SSE to "demonstrate" its value (Vo & Christie 2018) and develop stronger relationships with its stakeholders (Greiling & Stötzer 2015). The specificity of the mode of production of social economy organizations suggests however to go beyond traditional measurement tools (Mertens & Marée 2015; Mook, Richmond & Quarter 2003).

About this special issue:
The question that arises is the effect - not to say the impact! – on the SSE of the will to measure its impact. What are the ramifications of impact measurement and what consquences do they have on SSE activities? What are the similarities and differences between evaluation and impact measurement as conceived from a SSE or from a social finance perspective? What are the effects of different evaluation and impact measurement frameworks on the practices and development of SSE and its ecosystem? Knowing the particularities of the SSE, should we consider using specific methodologies and indicators so that its impacts can be recognized at their true value? Given the complexity of social and environmental problems, does the current trend for impact measurement oversimplify the issues? How should the SSE actors position themselves in this context?

Among the themes that can be the subject of contributions:
∙ Overview of different approaches to measuring social, economic and environmental impacts of the SSE.
∙ Analysis of emerging trends in the SSE financing (new public management, social finance, impact investment, social impact bonds ...) and their impact on SSE evaluation and impact assessment.
∙ Representations of the SSE in different methods or approaches to impact measurement ∙ Methodological challenges associated with measuring economic, social and environmental impacts of the SSE.
∙ Critical views about impact measurement of the SSE.

Submitting a proposal
· Call for papers opens: September 30, 2020
· Call for papers closes: December 30, 2020

Submissions with indication "Special Issue" to