This study explores the application of risk-sensitive Reinforcement Learning (RL) in portfolio optimization, aiming to integrate asset pricing and portfolio construction into a unified, end-to-end RL framework. While RL has shown promise in various domains, its traditional risk-neutral approach is unsuitable for financial contexts where risk sensitivity is crucial. This research focuses on risk-sensitive RL methods that incorporate different risk measures to manage uncertainty and volatility in financial markets better. The project extends existing RL techniques by adapting the cross-sectional approach to risk-sensitive settings and introducing new variants like PPO-CVaR and PPO-Expectile for portfolio management. A comparative study of these methods is conducted to assess their performance with real market data and simulated environments. The research addresses key questions related to how different risk measures impact learned portfolio strategies, the influence of risk appetite on decision-making, and the performance gap between simulated and real market data. The findings aim to provide insights for practitioners looking to implement risk-sensitive RL in financial asset management.

This paper explores the challenges of converting architectural floor plans from raster to vector images. Unlike previous studies, our research focuses on domain adaptation to address stylistic and technical variations across different floor plan datasets. We develop and test our vectorization method on the CubiCasa5K benchmark, which includes 3 different floor plan styles. Our analysis reveals differences in input features across the CubiCasa5K styles, indicating the potential for domain adaptation research, mostly in room segmentation. However, we also find multiple indications that labelling in the CubiCasa5K dataset is ambiguous and inconsistent. Furthermore, styles with more training data do not always perform better, highlighting the complexity differences between floor plan styles. Our baseline shows a 0.7% gap for rooms yet a 0.6% improvement for objects, likely caused by the smaller feature gaps and inconsistent labelling. To address the adaptation gap, we add a Multi-Kernel Maximum Mean Discrepancy (MK-MMD) loss to the CubiCasa5K model to minimize feature distribution differences between domains. While our MK-MMD implementation shows potential for reducing the adaptation gap, persistence issues and mixed results across classes make it difficult to draw clear conclusions. Our findings also show the role of balancing spatial context in the MK-MMD calculation. These insights lay a foundation for future domain adaptation research in floor plan vectorization.

Image data augmentation has been regarded as a reliable and effective way to increase the data available for training. With the advent and rise of Generative AI, generative data augmentation has been shown to realize even better gains in performance for downstream tasks. However, these performance gains are often the cause of "extra information" being seeped into the generated examples via pre-trained model weights, heuristic inclusions etc. In this paper, we showcase the impact of text-in-image augmentation on the performance of an underlying downstream task (classification or recognition). This study specifically looks at the difference in performance when training a classifier under three settings- no augmentation, transform-based augmentation, and generative augmentation- and investigate whether and where this augmentation can be successfully employed to experience gains in performance, without letting any "extra information" seep in. We try to observe this difference in performance under varying amounts of training samples, and for samples with varying similarities to that of the original training data. We also present a new GAN structure- conditional Classification Deep Convolutional GAN (or the CcGAN)- as an improved baseline over the conditional Deep Convolutional GAN (cDCGAN) for our experiments which gave a 4\% performance gain over unaugmented data with no 'extra information'. We find that in certain settings and examples, there exists a performance advantage to train vision models in text-in-image settings using real and generated data. We also confirm that the amount of original training samples available affect the test accuracy achieved by generative augmentation, where a huge fall-off can be seen in extremely low- and high- data regimes; however, it seems to maximize performance at a ”sweet spot” where the robustness and variability added by the generated samples help to realize performance gains. It was also observed that the 1x and 5x augmentations performed better than other configurations. Lastly, we find that the similarity of generations does not affect model performance and does not vary consistently with model performance for most settings.

Trust is a fundamental component in human-AI relationships, serving as a critical element of user acceptance and satisfaction, particularly within the realm of Decision Support Systems (DSS). The technological advances in conversational user interfaces (CUIs) such as ChatGPT and digital assistants (e.g., Alexa) allow laypeople to interact with DSS without knowing the mechanisms behind them.
Extensive research has explored the benefits of CUIs and strives to improve their usability and adoption rate. However, while interacting with such CUIs, how to facilitate proper user trust for decision support is still under-explored. To address the research gap, we aim to test the impact of emotional expressiveness in CUIs on building user trust.

To analyze the impact of emotional expressiveness in CUIs to build user trust and whether voice-based CUI is more efficient in building user trust compared to text-based CUI. We implemented a conversational interface with varying emotional expressiveness that can serve six conditions: two text-based and four voice-based. Text-based CUIs are differentiated by lexical expressiveness. Voice-based CUIs are varying in both lexical expressiveness and prosodic expressiveness. Regardless of the modality and emotional expressiveness, each CUI serves as an interactive medium for users with the DSS, which supports them to find a suitable house given a scenario.

Through an empirical study (N = 151), the experimental results are insufficient to conclude the impact of prosodic expressiveness and lexical expressiveness on user trust and usability in CUIs. In addition, we did not find any statistically significant difference between text-based and voice-based CUIs in trust or perceived usability.

Our findings can potentially be explained by the uncanniness effect [46]: initially, increased emotional expressiveness in a chatbot could positively influence user trust, but over time this could turn into a negative impact. These results offer a potential way to explain the complex dynamics of trust in conversational DSS and some implications in chatbot design within the context of DSS. Our findings
can benefit the future design and development of conversational agents-based DSS by considering emotional expressiveness.

The ever-evolving power grid is becoming smarter and smarter. Modern houses come with smart meters and energy conscious consumers will buy additional smart meters to place in their home to help monitor their energy consumption. This new smart technology also opens the door to more accurate power consumption forecasting. In this study we look at utilizing a partial hierarchy, in which one of the appliances in a household is modelled separately from the rest of the house, to help improve household energy consumption forecasting accuracy. This is done in conjunction with Auto Regressive Moving Average (ARMA) based models. Three variants of ARMA based models will be looked at: Auto Regressive Integrated Moving Average (ARIMA), Seasonal Auto Regressive Integrated Moving Average (SARIMA), and Auto Regressive Integrated Moving Average with Exogenous variables (ARIMAX). These methods will then be compared to more baseline approaches such as a persistence method and a seasonal moving average. Our analysis has led us to conclude that the partial hierarchy model offers little to no benefit when applied in the field of household energy consumption forecasting when built upon ARMA based models. ARMA based models in general appeared to be poor performers when it came to household energy consumption forecasting.

In today's society, the rapid progression of digitization has led to the automation of various facets of human existence. This transformation has been facilitated by the utilization of algorithms, which are instrumental in driving efficient and effective automated processes. These algorithms have also found widespread adoption in the public sector, where they are employed to streamline and optimize various tasks and operations. The integration of algorithms in the public sector has brought about significant advancements in areas such as predictive policing, social welfare allocation, and healthcare.

However, the use and development of these automated processes were subjected to concerns from the public about privacy, bias, accountability, and transparency. Since these concerns are mainly coming from citizens, their involvement in the process of developing algorithmic systems can potentially be of help.

We explore the potential of participatory AI in marginalized communities as a means of obtaining valuable input from citizens regarding the development of these algorithmic systems employed by the public sector. One Piece of our approach involves hosting discussions in local community centers in marginalized neighborhoods. Our focus is on dilemmas that are relevant to algorithm design and evaluation decisions, and we frame these dilemmas in various ways, including forms that may not directly relate to societal impact, but are understandable for laypeople. Our key findings suggest that involving marginalized citizens can bring valuable perspectives and insights that are otherwise ignored. By incorporating public perspectives into algorithm development, we can promote inclusive decision-making processes and ensure that algorithms align with community values.

Event-based cameras do not capture frames like an RGB camera, only data from pixels that detect a change in light intensity, making it a better alternative for processing videos. The sparse data acquired from event-based video only captures movement in an asynchronous way. In this paper an evaluation is made on the efficiency and accuracy of object detection, specifically localization, between sparse and dense representations of data. Convolutional Neural Networks are used to train and test on images and event-based data. The results show a positive trade-off in terms of accuracy and efficiency for using sparse event-based data instead of dense data like images. These results provide a basis for an argument to use event-based cameras instead of RGB cameras when dealing with object detection.

The event-based camera represents a revolutionary concept, having an asynchronous output. The pixels of dynamic vision sensors react to the brightness change, resulting in streams of events at very small intervals of time. This paper provides a model to track objects in neuromorphic datasets, using clustering. In addition, a non-linear filter is applied to correct the estimation of the object position. Both single and multi-object tracking algorithms are provided and their performance is analyzed using different metrics, including the clustering evaluation scores and the tracking accuracy. The accuracy is over 0.6 for multi-target tracking and more than 0.7 for single object tracking. Besides the proposed model, a comparison between different possible approaches for event-based data tracking is provided.

Instance segmentation on data from Dynamic Vision Sensors (DVS) is an important computer vision task that needs to be tackled in order to push the research forward on these types of inputs. This paper aims to show that deep learning based techniques can be used to solve the task of instance segmentation on DVS data. A high performing model was used to solve this task, using event-based data that was transformed into RGB-D images. The chosen model for this work was Mask R-CNN, with an alteration for depth images, because of its high performance on frame based data. The N-MNIST dataset provides the event-based input, and the transformation of such an input is presented in this study. Furthermore, the masks are generated with the help of the MNIST dataset and heuristics are used for placing them at the correct positions. The results are promising and comparable to other results from literature on the task of semantic segmentation.

Event-based cameras represent a new alternative to traditional frame based sensors, with advantages in lower output bandwidth, lower latency and higher dynamic range, thanks to their independent, asynchronous pixels. These advantages prompted the development of computer vision methods on event data in the last decade, however event-based datasets are still in early stages in terms of size and complexity compared to normal datasets (e.g. ImageNet). This paper explores event data augmentation by superimposing two existing event datasets (N-MNIST and N-Caltech101) and by adding uniform noise. It shows that training an instance segmentation model on noisy datasets does not improve its performance, but the amount and type of noise added in the background decreases the performance of such model.

Powerful predictive AI systems have demonstrated great potential in augmenting human decision-making. Recent empirical work has argued that the vision for optimal human-AI collaboration requires ‘appropriate reliance’ of humans on AI systems. However, accurately estimating the trustworthiness of AI advice at the instance level is quite challenging, especially in the absence of performance feedback pertaining to the AI system. In practice, the performance disparity of machine learning models on out-of-distribution data makes the dataset-specific performance feedback unreliable in human-AI collaboration. Inspired by existing literature on critical thinking and explanation-based human debugging, we propose the use of debugging an AI system as an intervention to foster appropriate reliance. In this paper, we explore whether a critical evaluation of AI performance within a debugging setting can better calibrate users’ assessment of an AI system and lead to more appropriate reliance. Through a quantitative empirical study (N = 234), we found that our proposed debugging intervention does not work as expected in facilitating appropriate reliance. Instead, we observe a decrease in reliance on the AI system after the intervention — potentially resulting from early exposure to the AI system’s weakness. We explored the dynamics of user confidence to help explain how inappropriate reliance patterns occur and found that human confidence is not independent of AI advice, which is potentially dangerous when trying to achieve appropriate reliance. Our findings have important implications for designing effective interventions to facilitate appropriate reliance and better human-AI collaboration

Metrics are widely used in the software engineering industry and can serve as Key Performance Indicators (KPIs), which are used by management to make informed decisions and understand the performance of the organisation. Many companies measure themselves against industry-standard metrics, in addition to their own set of metrics. This thesis aims to investigate the relationship between these industry-standard metrics and the metrics that are additionally collected. Instead of focusing on the performance of a single organisation, the DORA report focuses on the comparison of organisations. It measures the Software Delivery and Operational (SDO) performance of organisations by four key and industry-standard metrics representing two aspects, stability and throughput, of a software product. The use of one metric as a proxy for another metric or a thematic group of metrics is a common phenomenon. However, there rarely is evidence supporting the assumption that the proxy reflects the intended metric or represents the full thematic group. This thesis performs a single case study within ING, a large and highly digital bank in the Netherlands. It investigates the KPIs that are collected by the bank and analyses the relationships between those KPIs and the four metrics from the DORA report. It establishes a list of 27 KPIs that are in use by ING and shows that there are no correlations between the DORA metrics as collected within the bank and that these metrics show very little correlation with the metrics that ING collects additionally. Furthermore, it is established that nearly all metrics contain a bias at the organisational level and that these biases have a significant impact on the correlation between metrics.

Proper maintenance and inspection of aircraft and their engines is important for society. These engine inspections are performed using borescopes of which the footage is manually analysed. Having the opportunity to reconstruct a 3D model of the rotors would ease the inspection and introduce the possibility to automate the process. Monocular SLAM systems are capable of reconstructing such models in real-time using a video of the rotors. However, SLAM is not tested in environments similar to the aircraft turbine. This study, therefore, assesses the performance of different SLAM approaches in this specific setting. The results show that 3D reconstruction of aircraft engines using direct SLAM has potential for damage assessment. Further research into damage assessment using SLAM is therefore viable.

3D modeling techniques can be used to automate processes such as damage assessment in aircraft engines. Aircraft engines often have shiny and non-textured surfaces, where these modeling techniques often have poor performance. This paper gives more insight into the performance of interest detection/matching algorithms on shiny and non-textured surfaces as found in aircraft engine borescope inspection videos. These algorithms are often used in 3D modeling techniques. Three interest point detection/matching algorithms are executed on different test videos, and various metrics are calculated for each algorithm. This paper is the first paper that compares both recent and traditional computer vision interest point detection/matching algorithms in these specific settings, and contributes to a better understanding of the usability of feature-based 3D reconstruction techniques. The results show that more recent neural network-based approaches outperform traditional approaches.

More and more vehicles have multiple advanced driver-assistance systems (ADAS), that take over tasks from the human driver, thereby taking the driver out of the loop of control. This might create a discrepancy between the responsibility that the human driver feels and the responsibility that is attributed to them when something goes wrong. Previous studies into perceived responsibility were mostly conducted in traded control systems, in which either the vehicle or the driver was performing the task, and tasks were shifted between them. In haptic shared control systems the automation and human driver cooperate continuously. The Level of Haptic Authority (LoHA) determines how strong the controller enforces its guidance. We examine how this LoHA impacts the driver's own perceived outcome responsibility, as well as that attributed to the automation when the automation makes a mistake. We found that when authority is shifted towards the car, the human driver feels less responsible, and attributes more responsibility to the automation, but only to a certain degree. Our findings correspond with previous research and with our own hypothesis. They add a new perspective to the current literature, as this is the first research-paper to examine responsibility perception in haptic shared driving from the drivers perspective. More research in the human driver's experience is needed to better understand human behaviour whilst driving with driving automation systems.

In recent years, ships are expected to improve energy efficiency and reduce carbon emissions. For naval vessels, it is important to be able to maintain their mission profile. It is therefore required to provide real-time advice to the ship’s crew on the optimal speed and propulsion mode settings that include the actual environmental conditions. This paper proposes a novel machine learning approach to establish the ship’s fuel consumption per mile for the actual environmental conditions and develop fuel consumption curves for the various propulsion configurations. The proposed approach uses a multi-layer perceptron (MLP) model to establish the ocean parameters based on the own ship data, with an accuracy of 4.150 %. Using these ocean parameters combined with the own ship data, the fuel per mile is predicted and fuel consumption curves are established using an MLP-model, with an accuracy of 1.551 %. This thesis shows that the proposed approach makes it possible to help a ship’s crew make well informed decisions to reduce their CO2 emissions in real time while still meeting their mission profile. The proposed approach is especially useful for military operators since there is no need for external data sources. Further research is identified to optimize the proposed approach using a dataset containing a higher variety and number of environmental conditions and propulsion modes to improve and validate the fuel consumption curves for the entire spectrum of speeds, environmental conditions and propulsion modes.

In recent years financial fraud has seen substantial growth due to the advent of electronic financial services opening many doors for fraudsters. Consequently, the industry of fraud detection has seen a significant growth in scale, but moves slowly in comparison to the ever-changing nature of fraudulent behavior. As the monetary losses associated with financial fraud continue to grow, so does the need for efficient automated decision making systems. Simple decision making rules are often still the industry standard and only show decent results in the short-term, as reverse-engineering such rules is an easy task for smart fraudsters. Supervised learning systems as automated fraud detectors have shown promising results across the field, but are plagued by challenges uniquely prevalent in the field. Disproportional class imbalance in fraudulent transactions, as well as fraudsters continually adopting new schemes make training robust and generally applicable machine learning models an arduous task. This work introduces a novel machine learning pipeline, which makes use of carefully selected synthetic samples of this minority class to augment the training dataset of the supervised model. Synthetic samples representing fraudulent transactions are filtered based on a novel technique to quantify their expected performance as an adversarial example, using both data-driven and human-expert-driven techniques. By providing the supervised model with high-quality synthetic adversarial examples, we aim to improve its generalizability to never-seen-before fraudulent behavior and, in turn, improve its robustness to the volatile nature of financial fraud. Our results show that weakly-supervised models trained on our augmented datasets are able to detect 7% more fraudulent transactions compared to a baseline model trained on the standard dataset, at the cost of a 1% increase in false positives. Our calculations further show that applying this system could lead to a decrease of 1/6 in monetary losses incurred by financial fraud.