The need for engaging citizens in climate policymaking is increasingly recognised. Despite indications that the form of expert involvement can strongly influence participatory processes, this remains scarcely researched. We analysed two unique and contrasting cases of citizen engagement in national climate mitigation policy: (1) the Irish Citizens’ Assembly (ICA), the first national climate assembly involving live expert presentations and face-to-face deliberations; and (2) the Participatory Value Evaluation (PVE) on Dutch climate policymaking, where more than 10,000 citizens compared policy options in an online environment based on expert-based information on policy effects. Taking a dramaturgical approach, we found that the opening up and closing down of policy options and perspectives was influenced by the setting, staging and scripting of expertise. Apart from providing information on policy options, experts had significant roles in design choices and formulating recommendations, which shaped citizens’ deliberations and policy advice. In deliberative processes, citizens’ deliberations can be further influenced by putting experts in a privileged spot and emphasising their authority, whereas in the setting of an online tool, experts’ design choices may be masked by the fact-like presentation of expertise. Future research should further investigate the role of experts and expertise across a wider range of practices. Nevertheless, we conclude that the high degree of required technical knowledge in climate mitigation policy naturally implies strong expert involvement, which concomitantly steers the results. Alternatively, we may search to enhance citizens’ engagement in guiding climate policymakers by focusing on citizens’ normative perspectives.

@en

This paper presents a micro-econometric framework to analyse choice data from participatory value evaluation (PVE) surveys. In a PVE survey respondents receive, similar to stated choice surveys, information on the social impacts of public sector projects before choosing the best policy portfolio according to their preferences. Respondents’ choices are limited by governmental and private budget constraints. The PVE data format is characterised by a mixture of discrete and continuous choice data. Building on recent literature of Kuhn–Tucker models, particularly the MDCEV model, a range of methodological and econometric contributions are provided facilitating model estimation and policy evaluation. We derive a set of closed form choice probabilities explaining the choice for the optimal portfolio with public projects, private consumption levels and whether to spend the public budget in full or not. The proposed policy evaluation framework is centred around the notion of social welfare maximisation. The parameter estimates are used to derive the optimal public sector budget and the corresponding portfolio maximising social welfare, but also to rank the set of feasible portfolios given a restricted budget, including sensitivity analyses. The proposed framework is illustrated using an empirical example on urban mobility investments in Amsterdam, The Netherlands.

@en

Several studies examined what drives citizens’ support for COVID-19 measures, but no works have addressed how the effects of these drivers are distributed at the individual level. Yet, if significant differences in support are present but not accounted for, policymakers’ interpretations could lead to misleading decisions. In this study, we use XGBoost, a supervised machine learning model, combined with SHAP (Shapley Additive eXplanations) to identify the factors associated with differences in policy support for COVID-19 measures and how such differences are distributed across different citizens and measures. We use secondary data from a Participatory Value Evaluation (PVE) experiment, in which 1,888 Dutch citizens answered which COVID-19 measures should be imposed under four risk scenarios. We identified considerable heterogeneity in citizens’ support for different COVID-19 measures regarding different age groups, the weight given to citizens’ opinions and the perceived risk of getting sick of COVID-19. Data analysis methods employed in previous studies do not reveal such heterogeneity of policy support. Policymakers can use our results to tailor measures further to increase support for specific citizens/measures.

@en

Background: The stage of the pandemic significantly affects people’s preferences for (the societal impacts of) COVID-19 policies. No discrete choice experiments were conducted when the COVID-19 pandemic was in a transition phase. Objectives: This is the first study to empirically investigate how citizens weigh the key societal impacts of pandemic policies when the COVID-19 pandemic transitions into an endemic. Methods: We performed two discrete choice experiments among 2181 Dutch adults that included six attributes: COVID-19 deaths, physical health problems, mental health problems, financial problems, surgery delays and the degree to which individual liberties are restricted. We used latent class choice models to identify heterogeneous preferences for the impacts of COVID-19 measures across different groups of respondents. Results: A large majority of the participants in this study was willing to accept deaths to avoid that citizens experience physical complaints, mental health issues, financial problems and the postponement of surgeries. The willingness to tolerate COVID-19 deaths to avoid these societal impacts differed substantially between participants. When participants were provided with information about the stringency of COVID-19 measures, they assigned relatively less value to preventing the postponement of non-urgent surgeries for 1–3 months across all classes. Conclusions: Having gone through a pandemic, most Dutch citizens clearly prefer pandemic policies that consider citizens’ financial situations, physical problems, mental health problems and individual liberties, alongside the effects on excess mortality and pressure on healthcare.

@en

In this article, the affiliation details for author Jose Ignacio Hernandez were incorrectly given as ‘Center of Economics for Sustainable Development (CEDES), Faculty of Economics and Government, Universidad San Sebastian, Lientur 1457, Concepción, Chile ' but should have been ‘Center of Economics for Sustainable Development (CEDES), Faculty of Economics and Government, Universidad San Sebastian, Concepción, Chile. The affiliation ‘Transport and Logistics Group, Faculty of Technology, Policy and Management, Delft University of Technology, Delft, Netherlands’ for authors Jose Ignacio Hernandez and Niek Mouter was missing. The original article has been corrected.

@en

Objective: Increasing healthcare expenditures require governments to make difficult prioritization decisions. Considering public preferences can help raise citizens’ support. Previous research has predominantly elicited preferences for the allocation of public resources towards specific treatments or patient groups and principles for resource allocation. This study contributes by examining public preferences for budget allocation over various healthcare purposes in the Netherlands. Methods: We conducted a Participatory Value Evaluation (PVE) choice experiment in which 1408 respondents were asked to allocate a hypothetical budget over eight healthcare purposes: general practice and other easily accessible healthcare, hospital care, elderly care, disability care, mental healthcare, preventive care by encouragement, preventive care by discouragement, and new and better medicines. A default expenditure was set for each healthcare purpose, based on current expenditures. Respondents could adjust these default expenditures using sliders and were presented with the implications of their adjustments on health and well-being outcomes, the economy, and the healthcare premium. As a constraint, the maximum increase in the mandatory healthcare premium for adult citizens was €600 per year. The data were analysed using descriptive statistics and a Latent Class Cluster Analysis (LCCA). Results: On average, respondents preferred to increase total expenditures on all healthcare purposes, but especially on elderly care, new and better medicines, and mental healthcare. Three preference clusters were identified. The largest cluster preferred modest increases in expenditures, the second a much higher increase of expenditures, and the smallest favouring a substantial reduction of the healthcare premium by decreasing the expenditure on all healthcare purposes. The analyses also demonstrated substantial preference heterogeneity between clusters for budget allocation over different healthcare purposes. Conclusions: The results of this choice experiment show that most citizens in the Netherlands support increasing healthcare expenditures. However, substantial heterogeneity was identified in preferences for healthcare purposes to prioritize. Considering these preferences may increase public support for prioritization decisions.

@en

Objective: Here we investigate public preferences for coronavirus disease 2019 (COVID-19) certificates in the Netherlands, and whether these preferences differ between subgroups in the population. Methods: A survey including a discrete choice experiment was administered to 1500 members of the adult population of the Netherlands. Each participant was asked to choose between hypothetical COVID-19 certificates that differed in seven attributes: the starting date, and whether the certificate allowed gathering with multiple people, shopping without appointment, visiting bars and restaurants, visiting cinemas and theatres, attending events, and practising indoor sports. Latent class models (LCMs) were used to determine the attribute relative importance and predicted acceptance rate of hypothetical certificates. Results: Three classes of preference patterns were identified in the LCM. One class a priori opposed a certificate (only two attributes influencing preferences), another class was relatively neutral and included all attributes in their decision making, and the final class was positive towards a certificate. Respondents aged > 65 years and those who plan to get vaccinated were more likely to belong to the latter two classes. Being allowed to shop without appointment and to visit bars and restaurants was most important to all respondents, increasing predicted acceptance rate by 12 percentage points. Conclusions: Preferences for introduction of a COVID-19 certificate are mixed. A certificate that allows for shopping without appointment and visiting bars and restaurants is likely to increase acceptance. The support of younger citizens and those who plan to get vaccinated seems most sensitive to the specific freedoms granted by a COVID-19 certificate.@en

Participatory value evaluation (PVE) has recently been introduced in the field of health as a new method to elicit stated preferences for public policies. PVE is a method in which respondents in a choice experiment are presented with various policy options and their attributes, and are asked to compose their portfolio of preference given a public-resource constraint. This paper aims to illustrate PVE’s potential for informing healthcare decision making and to position it relative to established preference-elicitation methods. We first describe PVE and its theoretical background. Next, by means of a narrative review of the eight existing PVE applications within and outside the health domain, we illustrate the different implementations of the main features of the method. We then compare PVE to several established preference-elicitation methods in terms of the structure and nature of the choice tasks presented to respondents. The portfolio-based choice task in a PVE requires respondents to consider a set of policy alternatives in relation to each other and to make trade-offs subject to one or more constraints, which more closely resembles decision making by policymakers. When using a flexible budget constraint, respondents can trade-off their private income with public expenditures. Relative to other methods, a PVE may be cognitively more demanding and is less efficient; however, it seems a promising complementary method for the preference-based assessment of health policies. Further research into the feasibility and validity of the method is required before researchers and policymakers can fully appreciate the advantages and disadvantages of the PVE as a preference-elicitation method.

@en

We use Value Sensitive Design for the development of an ethical framework for autonomous systems in Defence in the Australian context. Two novel empirical data gathering methods are deployed for mining stakeholder's values, namely Group Decision Room (GDR) and Participatory Value Evaluation (PVE). GDR findings reveal a general concern for environmental values, geo-political and economic stability. A PVE based on these and other values is designed around an autonomous mine counter underwater vessel and an autonomous drone that drops bombs. @en

While several governmental and research efforts are set upon mobility-as-a-service (MaaS), most of them are driven by individual travel behavior and potential usage. However, considering only individuals’ preferences carries the risk of neglecting societal benefits going beyond individual travel behavior. This study addresses the valuation of different features of MaaS-services from a social desirability perspective as compared to social investments in biking infrastructure and in public transport, and aims at eliciting trade-offs between different features of such projects. This analysis is conducted on the basis of Participatory Value Evaluation (PVE). In PVE-experiments, individuals select their preferred portfolio of government projects given a constrained public budget and societal preferences for (the impacts of) government projects can be determined based on these choices. The results show that the population of Rotterdam exhibits a willingness to allocate public resources to all types of investment projects considered in the analysis. However, the willingness to allocate resources to bike infrastructure projects and public transport seems to be higher than the willingness to dedicate resources to MaaS subsidies. Within the different types of MaaS subsidies considered, subsidies aimed at sustainability exhibit a larger social valuation. Strong negative synergies among similar projects exist, signalizing that individuals prefer diversifying the use of public resources across different types of investment projects.@en

We propose three procedures based on association rules (AR) learning and random forests (RF) to support the specification of a portfolio choice model applied in data from complex choice experiment data, specifically a Participatory Value Evaluation (PVE) choice experiment. In a PVE choice experiment, respondents choose a combination of alternatives, subject to a resource constraint. We combine a methodological-iterative (MI) procedure with AR learning and RF models to support the specification of parameters of a portfolio choice model. Additionally, we use RF model predictions to contrast the validity of the behavioural assumptions of different specifications of the portfolio choice model. We use data of a PVE choice experiment conducted to elicit the preferences of Dutch citizens for lifting COVID-19 measures. Our results show model fit and interpretation improvements in the portfolio choice model, compared with conventional model specifications. Additionally, we provide guidelines on the use of outcomes from AR learning and RF models from a choice modelling perspective.@en

The COVID-19 pandemic has led to the introduction of transport-related policy measures worldwide. In this paper, we review the literature on factors that are important for the design of those measures, and their effects on safety, physical and mental health, economy and environment. We conclude that factors underlying the introduction of transport related measures are related to the broader discussion on COVID-19 measures (e.g. on social distancing). This makes it impossible to determine the independent influence of determinants aimed at transport on the effects (virus spread, economy, well-being). Furthermore, the effects of measures appear to differ strongly between countries. Important determinants for these effects are (1) socio-economic factors, (2) cultural factors, (3) political factors and (4) individual factors. In addition, the extent to which people can work at home appears to be very important for the introduction and effectiveness of COVID-19 measures. In the category of 'cultural factors', the degree to which people have a 'sense of civic responsibility' and trust in the government and institutions plays a major role in the compliance with advice and coercive measures. Furthermore, experiences with previous viruses appear to have made a positive contribution to COVID-19 policies that are successful at containing the virus. Finally, individual factors play a role in the compliance with COVID-19 measures. For example, a pro-social attitude is associated with better compliance. And: if people rate the effectiveness of such measures higher, they are more likely to act on them. The paper also provides recommendations for policy and further research.@en

Objectives: Research efforts evaluating the role of altruistic motivations behind health policy support are usually based on direct preference elicitation procedures, which may be biased. We propose an indirect measurement approach to approximate self-protection–related and altruistic motivations underlying preferences for public health policies. Methods: Our new approach relies on associations between on the one hand decision makers’ perceived health risk for themselves and for close relatives and on the other hand their observed preferences for health policies that reduce such risks. The approach allows to make a rough distinction between health-related self-protection and local altruistic motives behind preferences for health policies. We illustrate our approach using data obtained from a discrete choice experiment in the context of policies to relax coronavirus-related lockdown measures in The Netherlands. Results: Our results show that the approach is able to uncover that (1) people who think they have a high chance of experiencing health risks from a COVID-19 infection are more willing to accept a societal or personal sacrifice, (2) people with a higher health risk perception for their relatives have a higher willingness to accept sacrifices than people with a higher health risk perception for themselves, and (3) people who perceive that they have a high risk of dying of COVID-19 have a higher willingness to accept sacrifices than those anticipating less severe consequences of COVID-19. Conclusions: Our method offers a useful proxy metric to distinguish health-related self-protection and local altruism as drivers of citizens’ responses to healthcare policies.@en

The upcoming vogue of climate assemblies and other forms of mini-publics are to give citizens a central role in climate policy-making and to break the political impasse. Yet climate mini-publics face challenges in political environments too, such as co-option, favoring expert opinions, and losing touch with the broader public. To remedy such pitfalls, recent papers have argued to combine synchronous deliberations of small groups of citizens with online participation procedures for the larger public. In this article, we report the results of a three-step combination model, where first a mini-public in the region of Súdwest-Fryslân (NL) was given a “carte blanche” to draft the content and the parameters of several related policy alternatives. Second, their proposals were fed into a digital participation tool to consult the wider public. Third, a citizens forum translated the outcomes of the maxi-public into policy recommendations, which were unanimously approved by the municipal council. In this paper, we report our findings of combining mini- and maxi-publics and how the actors involved evaluated the strengths and weaknesses of the combination of these two participatory approaches.@en

The cost-benefit analysis (CBA) is a widely used approach for the appraisal of transport projects, but criticisms on it have led to the development of alternatives such as the BENEFIT approach. This book chapter analyzes three cases of infrastructure investments in port areas in Belgium and the Netherlands, by application of the BENEFIT approach. We find inter alia that differences in country performance on internationally accepted indicators can influence differences in infrastructure investments between countries. Moreover, infrastructure projects with larger revenue-generating possibilities will influence the PPP (public-private partnership) potential of this type of projects in a positive way. Applying different appraisal methods to the same infrastructure project might help to arrive at infrastructure project investment approvals that are well-documented.@en

Benchmarking is a method that can be used to measure progress and create awareness about the performance of organisations. Benchmarking the housing stock energy performance of Dutch housing associations can be used to measure and assess progress towards the decarbonisation of the housing stock. A new national climate agreement was signed in 2019, and in 2021 a new method to determine the theoretical energy performance of dwellings came into force in the Netherlands. To benchmark energy performance, a set of indicators is created that adequately represents the performance of Dutch housing associations according to the changed policies. A process involving key stakeholders is presented here to identify, assess and combine possible indicators. These were then integrated into four integrated models, which led to a final benchmark model. A model was chosen that consists of three indicators covering the energy performance of Dutch housing associations. The process and arguments that led to this final model are presented. While applicable within the Dutch context, the method and research results provide generalisable insights for the creation of energy performance benchmarks for building stocks.

@en

Energy communities are decentralized socio-technical systems where energy is jointly generated and distributed among a community of households locally. As the energy that is shared among the community is commonly electricity, the energy community's literature is dominated by electricity-systems and mostly neglects collective thermal energy as an alternative energy carrier for heating and cooling. Our goal in this article is to organise the existing research on “community-based initiatives for heating and cooling ” by using the Institutional Analysis and Development (IAD) framework, and based on this analysis, identify a future research agenda. Our analysis reveals that the number of publications in this area has been growing fast recently, focusing on technological challenges. Fewer papers take an institutional point of view, in which they cover policies, price reforms and values. The institutionally oriented papers focus on solar thermal energy and bio-based thermal energy. Other thermal technologies, such as geothermal wells, are largely neglected in the literature, but are known to have different institutional constraints. Informal rules and values are mainly researched from a consumer perspective. Since energy communities often consist of consumers and prosumers, additional research is warranted into this area. Evaluative criteria for such communities are limited to economic aspects and greenhouse gas emissions, while indicators such as soil pollution and spatial planning that may play an equally important role are neglected. We recommend studying thermal energy communities as distinctive entities with their own unique characteristics, and we develop a research agenda for this purpose.@en

Introduction
Currently, it is not known what attributes of health care interventions citizens consider important in disinvestment decision-making (i.e. decisions to discontinue reimbursement). Therefore, this study aims to investigate the preferences of citizens of the Netherlands toward the relative importance of attributes of health care interventions in the context of disinvestment.

Methods
A participatory value evaluation (PVE) was conducted in April and May 2020. In this PVE, 1143 Dutch citizens were asked to save at least €100 million by selecting health care interventions for disinvestment from a list of eight unlabeled health care interventions, described solely with attributes. A portfolio choice model was used to analyze participants' choices.

Results
Participants preferred to disinvest health care interventions resulting in smaller gains in quality of life and life expectancy that are provided to older patient groups. Portfolios (i.e. combinations of health care interventions) resulting in smaller savings were preferred for disinvestment over portfolios with larger savings.

Conclusion
The disinvestment of health care interventions resulting in smaller health gains and that are targeted at older patient groups is likely to receive most public support. By incorporating this information in the selection of candidate interventions for disinvestment and the communication on disinvestment decisions, policymakers may increase public support for disinvestment.@en

Achieving energy efficiency in the built environment requires extensive efforts in the renovation and adaptation of housing stock. A promising design solution is the heat pump. While gas boiler systems are commonly used in Dutch non-profit housing stock, the share of dwellings with a heat pump grew from 1.6% in 2017 to 3.2% in 2021. However, building characteristics and the energy consumption of dwellings with a heat pump are unclear. Therefore, a dataset of 69,422 dwellings with different types of heat pumps has been examined and compared to dwellings with a traditional HR107 condensing gas boiler. This research reports average characteristics and the average actual energy consumption of dwellings with all-electric, hybrid and gas absorption heat pump systems. Dwellings with a heat pump system are on average of higher building quality, their gas consumption is lower and their electricity consumption is higher than dwellings with an HR107 condensing gas boiler. Detailed insight is provided for dwellings with different heat pump systems and for dwellings with different building characteristics. Further research to determine the energy performance of dwellings with specific heat pump configurations is recommended in light of the energy transition in the built environment.

@en

Background: Vaccination is generally considered the most direct way to restoring normal life after the outbreak of COVID-19, but the available COVID-19 vaccines are simultaneously embraced and dismissed. Mapping factors for vaccine hesitancy may help the roll-out of COVID-19 vaccines and provide valuable insights for future pandemics. Objectives: We investigate how characteristics of a COVID-19 vaccine affect the preferences of adult citizens in the Netherlands to take the vaccine directly, to refuse it outright, or to wait a few months and first look at the experiences of others. Methods: An online sample of 895 respondents participated between November 4th and November 10th, 2020 in a discrete choice experiment including the attributes: percentage of vaccinated individuals protected against COVID-19, month in which the vaccine would become available and the number of cases of mild and severe side effects. The data was analysed by means of panel mixed logit models. Results: Respondents found it important that a safe and effective COVID-19 vaccine becomes available as soon as possible. However, the majority did not want to be the first in line and would rather wait for the experiences of others. The predicted uptake of a vaccine with the optimal combination of attributes was 87%, of whom 55% preferred to take the vaccine after a waiting period. This latter group tends to be lower-educated. Older respondents gave more weight to vaccine effectiveness than younger respondents. Conclusions: The willingness to take a COVID-19 vaccine is high among adults in the Netherlands, but a considerable proportion prefers to delay their decision to vaccinate until experiences of others are known. Offering this wait-and-see group the opportunity to accept the invitation at a later moment may stimulate vaccination uptake. Our results further suggest that vaccination campaigns targeted at older citizens should focus on the effectiveness of the vaccine.@en