Much Ado about Accessibility

Abstract

Autism Spectrum Disorder (ASD) is a neuro-developmental disorder reported to affect around 58 million people across the world. Due to their struggles with social communication in real life, they prefer to use online mediums to form social connections and are better able to maintain meaningful relationships through their communications over these online mediums. However, empirical studies have revealed that autistic users are not as efficient in using these online mediums when they have to search for information. While studies in the past have resulted in a growing list of guidelines to improve the web search experience of autistic users, whether existing online ISTs adhere to these guidelines has not been studied extensively. Thus while we know what the autistic users need to efficiently look for information on the web, we do not know if and how the ISTs are catering to their accessibility needs.

To advance knowledge in the accessibility of popular online ISTs when catering to the information needs of autistic users, we conducted an empirical exploration focusing on the accessibility of the textual
information in the IST responses. We specifically examined the responses on three aspects of text accessibility for autistic users - (1) text structure, (2) text readability, and (3) text concreteness using
“accessibility indicators” i.e. quantifiable features created by us based on widely accepted web content accessibility guidelines for autistic users. Due to the lack of standard query datasets for autistic users, we had to generate synthetic queries representative of autistic users’ information needs to collect responses from four popular ISTs Google, Bing, Gemini, and ChatGPT. We examined the differences in the way ISTs respond to queries characteristic to autistic users in contrast to queries typically asked by the general public, as well as the differences in IST responses across different kinds of queries asked by autistic users. We also investigated if an autistic user were to reformulate their query and explicitly state that they are autistic in their query would nudge the IST to respond differently to their query.

Juxtaposing the IST responses generated for control and ASD group queries revealed that the ISTs not only responded differently to the queries asked by the two user groups, but the responses generated for the control group were surprisingly more accessible for autistic users than the IST responses generated for their queries. For queries typically asked by autistic users, none of the ISTs produced responses
suitable for autistic users. However, each IST had its strengths in the context of the accessibility which can employed in the other ISTs to improve the general accessibility of the responses generated by all ISTs. We also found that our query and prompt reformulation strategies affected the accessibility of each IST differently. In general, the reformulations did nudge the ISTs to generate responses that are more suitable for autistic users. This presents an optimistic solution to the issue of ISTs not catering to the accessibility needs of autistic users when they search for information on the web. Our results highlight areas where popular ISTs can be improved to make their responses more accessible to autistic users. Our systematic empirical investigation pipeline can also be extended to investigate IST responses on other factors that influence the accessibility of web content for autistic users.