Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You or Your Team.

Learn More →

WordMelodies: Supporting the Acquisition of Literacy Skills by Children with Visual Impairment through a Mobile App

WordMelodies: Supporting the Acquisition of Literacy Skills by Children with Visual Impairment... WordMelodies: Supporting the Acquisition of Literacy Skills by Children with Visual Impairment through a Mobile App DRAGAN AHMETOVIC, Università degli Studi di Milano, CRISTIAN BERNAREGGI, Università degli Studi di Milano, BARBARA LEPORINI, Istituto di Scienza e Tecnologie dell’Informazione, CNR, SERGIO MASCETTI, Università degli Studi di Milano, WordMelodies is a mobile app that aims to support inclusive teaching of literacy skills for primary school students. Thus it was designed to be accessible both visually and through screen reader, and it includes over 80 diferent types of exercises for practicing literacy skills, each with adjustable diiculty levels, in Italian and in English. WordMelodies is freely available for iOS and Android devices. However, it has not been previously evaluated with children having visual impairments. Thus, in this paper, we evaluate the app usability, its perceived ease of use, appreciation and children’s autonomy while using it, as well as the characteristics of the end users. To achieve this, we conducted a user study with 11 primary school students with visual impairments, and we analyzed app usage logs collected from 408 users in over one year from the app publication. We show that app usability is high, and most exercises can be completed autonomously. The exercises are also perceived to be easy to perform, and they are appreciated by the participants. Finally, we provide insights on how to address the identiied app limitations and propose future research directions. CCS Concepts: · Human-centered computing → Accessibility; · Applied computing → Interactive learning environments; · Social and professional topics → K-12 education. Additional Key Words and Phrases: Visual impairment, Literacy education, mobile edutainment apps. 1 INTRODUCTION Primary school teaching materials, both print-base e.g., dte(xtbooks) and digital e.g.(, educational apps), often use graphical content as a means to engage very young students. Additionally, illustrations are also used to convey complex concepts, for example in geometry or mathematics 6]. The [ illustrations also provide the bridge between listening and early reading behavior 39], and [ therefore they are also invaluable for the early formation of literacy and phonemic skills. However, such materials may not be accessible for children with severe visual impairments or blindness (VIB) [27]. For these children, the lack of adequate teaching materials is a critical limitation for the development of literacy skills 12, 22[]. While accessible alternatives, such as braille18b]oor okstactile [ drawings 39],[ exist, these have a number of limitations. They are diicult to design and produce, they are commonly available only in special education settings 17],[but rarely present among the resources of inclusive classes 47], and [ they are not inclusive to sighted students, which may contribute to social exclusion of students with VIB [57]. Authors’ addresses: Dragan Ahmetovic, dragan.ahmetovic@unimi.it, Università degli Studi di Milano, ; Cristian Bernareggi, cristian. bernareggi@unimi.it, Università degli Studi di Milano,; Barbara Leporini, barbara.leporini@isti.cnr.it, Istituto di Scienza e Tecnologie dell’Informazione, CNR,; Sergio Mascetti, sergio.mascetti@unimi.it, Università degli Studi di Milano, Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for proit or commercial advantage and that copies bear this notice and the full citation on the irst page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior speciic permission and/or a fee. Request permissions from permissions@acm.org. © 2022 Copyright held by the owner/author(s). Publication rights licensed to ACM. 1936-7228/2022/10-ART $15.00 https://doi.org/10.1145/3565029 ACM Trans. Access. Comput. 2 • To address these issues, we presentWordMelodies [2, 43], a mobile application to support children in the acquisition of basic literacy skills. The app was designed to be inclusive for children with and without VIB, thus promoting interaction between them. WordMelodies also supports children in exercising basic touchscreen interactions on mobile devices, thus promoting digital literacy as well. The app design involved teachers of children with visual impairments and accessibility specialists, through multiple, user-driven iterations, with a universal design60 appr ]. Curr oachently [ , it features over 80 diferent, language-speciic exercises, in English and Italian languages, with 5 unique exercise families, each with a diferent interaction modality Wor.dMelodies was developed as a cross-platform software, and it was published for free 1 2 on mobile app stores for both Android and iOS platforms . The app was publicised through associations of people with VIB, during classes with children with VIB, and through blogs for accessible learning for people with VIB [21]. We previously presented a preliminary evaluation conducted with adults with visual impairments to assess app usability and accessibility 2]. Study [ results unveiled that the app is indeed accessible and usable by people with VIB. After the publication we also initiated anonymous remote collection of app usage data, aiming to investigate how end users interact with the system. 1.1 New Contributions This paper extends our prior work 2],[ presented at the 18th International Web For All Conference, with two additional key contributions: • Our conference paper presented a limited user study with 4 adults with visual impairments, aimed only at assessing the app accessibility and usability. In this extension we present the results of a user study conducted with 11 children with VIB that use WorddMelodies under the supervision of an educator. The focus of the study is to evaluate the usability of the system perceived by children, and to assess whether the ive proposed exercise families are perceived by the educators to be easy to use, appreciated and suitable for autonomous usage by the children. • During our prior work we initiated remote collection of usage data from end users, reporting only basic statistics on the irst month of the collected data. After over a year of collecting data, we analyze it to improve our understanding of: a) the adoption of the system, considering user language, the device used, and screen reader usage b) exercise usage, in particular considering usage frequency, error frequency and distribution by types of exercises, user language, and screen reader usage. Results of our user study show thatWordMelodies is perceived to be highly usable by the children, with an average System Usability Scale (SUS) 36, [53] score of 79. Most participants were also able to complete the exercises without assistance, including exercises based on the drag&drop interaction. This is notable because this form of interaction is known to be particularly challenging for users 34].with Since VIBthe [ drag&drop interaction was particularly successful we provide some details on how we designed it. Most exercises were considered easy to use and were appreciated by the participants. However, exercises involving the selection of multiple elements in a table were perceived to be more diicult to perform autonomously. Indeed, 6 participants had to be assisted and one did not manage to complete these exercises at all. The diiculties with table exercises might be associated to the high number of elements that need to be explored, and the need to keep track of those elements that have been selected. Through remote logging, we collected usage data from 408 users. The participants had an explorative behavior, accessing many exercises before choosing the one to solve. This indicates that the exercise selection interaction should be modiied to make it easy for the users to ind the intended exercise. Another inding is that Italian https://play.google.com/store/apps/details?id=com.wordmelodies https://apps.apple.com/it/app/id1495831516 ACM Trans. Access. Comput. WordMelodies • 3 users also tried exercises in English, showing that the app could be useful for learning foreign language literacy. Language-speciic exercises were also among the most commonly used ones, indicating that correct localization and internationalization of exercises is a top priority. Errors in exercises were uneven, indicating that some exercises might require more training to develop the associated literacy and interaction skills. 2 RELATED WORK 2.1 Development of Literacy Skills in Sighted Students and Students with VIB Primary school teaching materials for developing literacy skills often rely on illustrations65and ] visual cues [ because visual reminders support the early formation of literacy and phonemic 39].skills Thus, similar [ learning activities are invaluable to engage students and to support the understanding of more complex concepts 11, 66]. [ Moreover, in the last decades, there has been extraordinary growth in the use of animations and multimedia [15, 32, 49] to teach literacy skills. In recent years, an increasing number of mobile device applications have been proposed for teaching basic literacy skills through gamiication 10, 26].[Such solutions have been adopted in primary school programs as well as in homework activities to foster emergent literacy 5, 50 skills ]. Indee[d, research indings indicate that preschoolers and students in early classes of primary school show signiicantly higher basic literacy skills (e.g., letter name and sound knowledge, print concepts, name writing skills) after hours of exposure to similar edutainment games [26]. Prior literature suggests that similar sensory and interactive strategies are needed also for children with VIB to support the development of oral language and literacy 12, 22 [ ]. Indeed, while family support can to some degree improve the literacy skills in children with 14], prior VIB [ works suggest that irst hand experience with literacy exercises is needed for promoting literacy among children with 61]. Ho VIB we[ver, visual-based educational strategies and technologies, adopted to teach literacy to sighted young students, are not accessible without sight. Thus, they are not adequate to engage and teach the same concepts to students with severe VIB [16, 27]. 2.2 Education Materials for Students with VIB Printed teaching materials, and in particular those that use illustrations, are not accessible to students with severe VIB [19]. For these students, accessible solutions, such as Braille books or tactile drawings, are often used [18]. These solutions are an efective support for teaching activities aimed at children with 17se ]. vere VIB [ However, such instruments are rarely available outside special education47classes ]. Typically [ , tactile materials are also diicult to produce since illustrations are complex to render non-visually 19]. Therefor [ e they are seldom available for children with severe17VIB , 27].[ Furthermore, tactile materials cannot be modiied once created and their interactivity is limited. Additionally, tactile materials are commonly designed solely for the support of people with VIB, without considering the inclusiveness and collaboration with other 63],childr whichen can[ potentially lead to social exclusion [57]. Similarly to printed materials, digital teaching materials also use visual interactions, animations and drawings to stimulate learning, which often makes them inaccessible to students with se54 ver , 58 e VIB ]. To[address this issue, approaches using haptic devices to access graph data have been investigate 9, 67].dHo [ wever, these devices are uncommon and haptic representations need to be speciically designed. Approaches based on touchscreen interactions on mobile devices have also been proposed. These solutions can convey spatial information through the proprioceptive exploration of the touchscreen surface 41]. The [ y have been used to convey mathematical concepts [24], learn simple shapes 3,[42] or visualize graph data 51].[ Such approaches are convenient because commodity devices can be used, they are highly interactive, and they are also inclusive since visual representations can be associated to non-visual touchscreen exploration. ACM Trans. Access. Comput. 4 • Tactile materials, augmented with digital interactions to increase their interactivity, have also been investigated. One possible solution are 3D printed models embedding touch sensors 55]. Other [ approaches detect interaction using computer vision detection through external devices 56]. These [ solutions, however, are complex to design and produce. Approaches using tactile overlays for touchscreen devices 33, 46[] mitigate the production costs required for 3d printed models. They are more inclusive as visual touchscreen access is still possible, and overlays can be easily swapped. However, the overlays still need to be carefully designed and printed. 2.3 Education Materials for Developing Literacy Skills in Students with VIB Prior literature stresses the importance of using adequate materials to support emergent literacy in children with VIB28 [ , 61]. However, only few works propose education materials for this16 goal ]. An[ exploratory study reports positive efects of tactile illustrations on storybook comprehension by children 8].with One prior VIB [ work [61] describes a speciic program developed by the American Printing House for the Blind which includes a handbook and 27 tactile-visual read-aloud story books. Others propose design and usage guidelines for tactile materials, indicating advantages in supporting emergent literacy skills for children with VIB [31, 39, 44]. To date, very few digital solutions support emergent literacy in children with VIB. The lack of accessible digital teaching materials is particularly relevant in situations that require remote teaching, without being able to use materials available in class, as during the school lock-down due to the COVID-19 pandemic 38]. [ Considering mobile applications, most of those available for children with VIB are designed to teach basic Braille literacy: Exploring Braille with Madilyn and Ruf [62], Braille Buzz [4], and Braille Sheets [52]. Even though these applications support Braille literacy, they are limiteExploring d in scopBraille e. with Madilyn and Ruf and BrailleBuzz are speciically designed for early-stage braille learning, and in particular they teach how to identify and produce single Braille letters. Braille Sheets can be used with pre-printed Braille sheets superimposed on an iPad touchscreen. This solution is limited due to the type of interaction with the pre-printed braille sheets, which does not allow the student to interact with the iPad in the same way that their sighted peers are interacting with literacy gamese.g. ( , literacy exercises based on drag&drop, complete the word with missing letters, unscramble words, delete the wrong letter, and so on). 3 SYSTEM DEVELOPMENT The idea behind WordMelodies was suggested by a teacher for children with VIB from USA who reported that there is a lack of accessible apps to practice literacy skills for primary school children. Guided by this observation, the research team started the app development with an iterative design process. The design involved two iterations with educators for children with VIB, accessibility experts, and researchers. In the following we report the main design principles, identiied after the two iterations, the strategies adopted to implement these principles, and the key characteristics of the inal app. Additional details on each iteration can be found in our previous paper [2]. 3.1 Problem Analysis We irst aimed to identify which exercises could be more efective in supporting the learning of children with VIB. For this, we created a list of 56 possible exer,cises deined based on current teaching standards13[, 29, 45], existing educational apps (most of which were inaccessible), and informal interviews with three domain experts: the same teacher who reported the problem, a congenitally blind expert in assistive technologies (a co-author of this paper), and a primary school teacher from Italy. After creating the list of the potential exercises, we presented each exercise to two of the domain experts, also providing an example of how children with VIB could interact with the app while performing the exercise. Then, we asked the experts to specify, for each presented exercise, a subjective evaluation of the exercise usefulness, https://wmel.netlify.app/ ACM Trans. Access. Comput. WordMelodies • 5 and optionally to provide additional comments. The results of this formative activity were used, in the following development phases, to select which exercises to implement within the app. Informal interviews with the two domain experts were also conducted to elicit key design principles that were then used to guide the app engineering and implementation. The design principles that were identiied are: • Inclusiveness. The app should be usable by both sighted children and children with VIB. • Entertainment. To engage and keep the children interested the app should be entertaining. • Independence. Children should be able to use the app also without supervision by adults. • Consistency. Interactions and interfaces should be consistent among diferent exercises. For example, interactive elements having the same functionality should have the same colors and positions in all the screens. The interactive elements should possibly be close to the screen corners. • Beyond tap. Interviews with the domain experts highlighted that the app should help children to exercise common yet complex interaction gestures, like drag&drop. This is the opposite of the łsimple gesturež principle adopted in similar applications [1, 24]. • Scalability. New exercises should be easy to create. • Multi-platform. To reach all potential users, the application should be available for all mobile systems (iOS and Android) and device form factors (smartphones and tablets). 3.2 Design To implement the outlined design principles, WordMelodies adopts a number of strategies, the most important being the following : (1) To enable inclusive and entertaining interactions WordMelodies adopts speciic design principles to support visual access, as well as the accessibility by people with low vision and screen-reader users. Speciically, to support access by people with low vision, WordMelodies uses large text, high contrast visual elements, and consistent color coding. Furthermore, system accessibility services, such as zoom and negative color ilter can also be used. To support inclusive access to blind people, people with low vision, and sighted people Wor,dMelodies uses audio-icons 23[], interface elements which combine visual and auditory aspects and interactions. Indeed, all interactive elements are accessible by hearing and sight. Consider the example in Figure 1(a): upon touching the picture of the lion, the audio of its roar is played. Then, when the child slides the inger among the letters on the touchscreen, if the screen reader is active, it reads each letter and a corresponding word to support the comprehension of the letter e.g.,(łI for icež). (2) To support children in learning and exercising common touchscreen interactions WordMelodies deines 5exercise families, each requiring a diferent interaction. The way to interact with each exercise is explained through a tutorial that can be accessed from the exercise itself. Furthermore, carefully designed verbal messages are provided during the interaction explaining each step of it. The ive exercise families are presented in detail in following section. (3) To ease scalability and consistency, the ive exercise families can be used as a template to create many diferent exercises having a common interaction mode. For example łselect the antonymž (see Figure 1(d)) and łselect the rhymež are diferent exercise types in the same family. With this approach, diferent educational goals can be pursued with the same interaction, hence increasing consistency. This approach also eases scalability. Indeed exercise families are implemented so that exercises for each family are deined in a static ile. Hence, adding new exercises within the same family does not require writing additional code, only extending the static ile. see our previous paper [2] for the full list ACM Trans. Access. Comput. 6 • 3.3 Exercise Families CurrentlyWordMelodies deines ive exercise families (see Figure 1), with a total of 82 exercise types (46 in English and 36 in Italian). The ive exercise families are: • drag (drag the correct element). Exercises in this family require the child to drag one or more elements to one or more destination areas. Hints can be provided in the form of an audio-icon or a word that is read aloud. In the example in Figure 1(a) there is an audio-icon representing a lion and the letters łL", blank space, łOž, łNž. In the line below, there are three draggable letters łI", łE", łO". Another exercise in the same family is łreorder the letters in the alphabetž (see Figure 2) in which there are three empty spaces and three letters (i.e., draggable elements) to reorder. • keyboard (write with software keyboard). In these exercises the child has to insert one or more letters selecting them from a simpliied soft keyboard. Hints can be provided in the form of an audio-icon or a text that is read aloud. In the example of Figure 1(b) upon touching the speaker icon the text łI for icež is read aloud. Then, the child has to insert the right letter in the box. Another exercise in the same family requires the child to complete a word by inserting the right letters into a list of empty boxes (e.g., to write the dogž ł word). • baskets (drag an item to the correct basket). Exercises in this family present one element in the screen center that should be dragged to the right target on the left or the right of the screen. The example of Figure 1(c) shows the element duchessž ł that should be dragged over the łmalež or łfemalež targets. Another exercise in the same family requires to distinguish between nouns and verbs. • selection (select the correct answer). In these exercises the child has to select the correct answer from a set of possible answers by tapping it. In the example of Figure 1(d) the child has to select which is the antonym of diicultž ł selecting among easyž ł , łhardž, łjoyž. Another exercise in the same family requires the child to select the word (in a set of three) that rhymes with a given word. • table (select multiple answers in table). In this exercise the child has to select, by tap, one or more answers from a set of possible ones, and then press done ł .ž The exercise is correct if all the related elements (which can vary in number) were selected. For example, in Figure 1(e) the child has to select all the words related to the word łbeachž. There are nine choices, ive of which are relate e.g. d,(łwave,ž łsandž) , and four are not (e.g., łgirafe,ž łtelevisionž). 3.4 Drag&Drop Design Learning and performing the Drag&Drop interaction on touchscreen via screen reader is known to be diicult for people with VIB34[]. In this interaction the users irst select the target object to move, by exploring the touchscreen surface with the inger or by swiping left/right to sequentially traverse the available objects. Then they perform a double tap and hold the inger on the screen to start dragging the selected element. This latter gesture is independent from the position of the selected element on the screen. Then, the users can drag the inger on the screen, thus moving the selected element and receiving indications of the areas traversed. However, in the default implementation of this interaction it is not clear whether an element can be dragged, whether a traversed area is an eligible target area, and whether the target area is already occupied. We describe the design principles that we adopted to improve the accessibility of this type of interaction in the drag family exercises. Note that the following design principles do not apply baskettofamily the exercises as they have a much simpler interaction e.g., (there is only one draggable element and two eligible areas that cannot be occupied). Speciically, we implemented personalized solutions for people with low vision and for screen-reader users. For users with low vision, we made sure that all interactive elements are clearly distinguishable. Speciically, the draggable objects are all highlighted in ochre yellow, the target areas are painted in light grey, the starting ACM Trans. Access. Comput. WordMelodies • 7 (a) Drag the correct element(s) (b) Write with software keyboard (c) Drag an item to the correct basket (d) Select the correct answer (e) Select multiple answers in table Fig. 1. Examples of exercises inWordMelodies from the five diferent exercise families. area of a dragged element is in dark grey, and the background is in light blue. While the ability to adapt the actual colors to the speciic users needs might be useful, we argue that the design principle of clearly distinguishing these elements eases the interaction. For screen-reader users we carefully designed a series of voice messages to be read during interaction (the following examples all refer to Figure 2): • draggable objects are indicated with an hint e.g., łO ( for Orange [pause] draggable elementž). • upon starting the drag gesture, the object being dragged is repeate e.g. d ,(łYou are moving O for orangež). • the user is informed when the dragged object enters a target area and if the target area is already occupied (e.g., łEmpty Box 1ž). • the user is informed when the dragged object leaves a target areea .g.,(łBox 1 left, release to cancelž). • the user is informed when the dragged object is placed in a targete.g. ar,eałO(for Orange placed in Box 1ž). ACM Trans. Access. Comput. 8 • Fig. 2. Drag&drop example (screenshot taken while the leter łOž was being dragged). We also limited the number of elements to drag to a maximum of 3. Since there are few elements, it is possible to represent them in large dimensions also on smartphone devices. In turn, this eases readability for people with low vision and simpliies interaction for screen-reader users. Finally, we highlight that the corresponding tutorial exercise was also carefully designed to explain how to perform the drag&drop gesture step-by-step. 4 USER STUDY In our previous work, we described the accessibility evaluation of the app, conducted with adults 2].with VIB [ Here, we describe a new study, conducted with a group of children with VIB, aimed at evaluating the app usability and assessing the participants’ perceived autonomy, ease of use and appreciation of the touchscreen interaction modalities implemented in the ive exercise families. The evaluation of the educational WordMelo eicacy dies of is beyond the scope of this paper. 4.1 Experimental Design 4.1.1 Participants. A group of children with VIB has been recruited by the Institute for Research, Training and Rehabilitation (I.Ri.Fo.R.), which is a foundation managed by the Italian Union for Blind and Visually Impaired People (UICI) to carry out speciic research, training and rehabilitation activities for people with VIB. All participants accessed the Italian version of the app. Participants’ demographic data is summarized in Table 1; łTS experiencež is the previous experience in the use of touch-screen, A ł T usedž is the assistive technology used during the experiment. Eleven participants with VIB (6 M, 5 F) with an age range between 5 and � 11 = 8(.91, �� = 2.34) participated in the study. Two children (P6 and P9) were blind, and the other 9 had severe visual impairment. The two participants who were blind,�and 5 who could not interact with the app visually, used the screen reader. All the other participants had suicient residual vision to be able to interact with the app visually, and therefore did not use any accessibility services (zoom, text enlargement, inverted colors). We believe that this is due to the fact thatWordMelodies already uses very large font and high contrast colors, as highlighted in Section 3.2. Most participants had frequent prior experience with touchscreen interaction (P1, P3, P4, P5, P8, P10), while two sometimes used touchscreen devices (P2, P6) and three never (P7, P9, P11). 4.1.2 Apparatus. The study was conducted at the I.ri.Fo.R. institute in Pisa. During the tests, the participants were supported by a typhloinformatics educator. For the study, an iPad air tablet with iOS 13 was used. For the three participants that needed it, VoiceOver screen reader was used. Data about the participants and the study was collected via questionnaires completed by the educator using digital documents. Participants’ demographic data were collected anonymously and included sex, age, visual condition, and self-reported touchscreen interaction experience (frequent, sometimes, never). Consent forms were ACM Trans. Access. Comput. WordMelodies • 9 Table 1. Participants’ demographic data. AT: Assistive technology, TS: Touchscreen PID Sex Age Visual condition TS experience AT used P1 F 8 Low vision Frequent None P2 F 10 Low vision Sometimes None P3 F 10 Low vision Frequent None P4 M 11 Low vision Frequent None P5 M 11 Low vision Frequent VO P6 M 11 Blind Sometimes VO P7 M 5 Low vision Never None P8 F 9 Low vision Frequent None P9 M 7 Blind Never VO P10 M 11 Low vision Frequent None P11 F 5 Low vision Never None collected for each participant. For each exercise family, we collected the educator’s assessment of the participant’s autonomy in performing the exercise (autonomous, supported, not-completed), as well as the ease of use and appreciation of the exercise with values on a 1-5 scale where 1 and 5 indicated low and high ease of use or appreciation respectively. We also assessed the usability of the app through a version of the System Usability Scale (SUS) [36] adapted for use with children [53]. 4.1.3 Protocol. Before the study, the educator described the study to the child’s parents and had them sign the study consent form. Afterwards, demographic data was collected for the participant performing the test. The educator then introduced the app to the participant and initiated the study tasks. A set of 5 tasks has been deined for the user test, one for each exercise family. Each task included a series of 4 exercises of the same type. Speciically, the tasks were: • keyboard, alphabet: write the correct letter of the alphabet in the box. • selection, rhymes: select the word rhyming with a given word. • baskets, vowels and consonants: drag the letter in the correct basket. • drag, articles: drag the correct determinative article in the box. • table, proper nouns: select proper nouns in the table. The irst exercise was used to show the participant how the interaction in the considered exercise family works and it was not considered in the following data analysis. The participant was then asked to perform the other 3 exercises autonomously. This procedure was replicated for each task. Thus, a total of 20 exercises were performed by every participant, of which 15 were observed and considered for data analysis purposes. The study took about 30 minutes for each participant. The educator was asked to observe the participant when performing the tasks and to take notes while the user was interacting with the exercises on the touchscreen. More speciically, the educator was asked to: (1) take note of the start and end date/time of the test for each participant. (2) take note of any diiculties the children encountered in performing the exercises. (3) take note of whether the tasks were completed, and how (independently or with support). For each task, the educator also assessed, on a Likert scale from 1 to 5, the ease of use and the perceived appreciation by the participant, for the considered exercise. After all the tasks, the participant was also asked an adapted version of the System Usability Scale (SUS) questionnair 36], designe e [ d to be suitable for childr 53en ]. [ ACM Trans. Access. Comput. 10 • 4.2 Results 4.2.1 Autonomy, Ease of Use, and Appreciation of Diferent Exercise Families.For most exercise families, the participants were able to solve the exercises autonomously (see Table 2). 9 participants were abledrag to solve exercises autonomously, while 2 (P9, P11) required assistance Keyboar . d, selection, and baskets exercises were solved autonomously by 8 participants each. ke Foryboard, P2 and P9 required assistance, and P11 could not complete the exercises. This participant could not complete selection exercises as well, while P7 and P9 required assistance with them. Instead, for drag exercise family, P7 and P11 required assistance while P9 did not manage to complete them autonomouslyT . able was the most problematic exercise family, with only 4 participants (P2,P3,P5,P8) who were able to solve them on their own. Among the others, 1 participant could not complete these exercises (P11) and the remaining 6 required assistance. Table 2. Exercise families completed autonomously (A), with support (S) or not completed (NC) PID Keyboard Selecting Baskets Drag Table P1 A A A A S P2 S A A A A P3 A A A A A P4 A A A A S P5 A A A A A P6 A A A A S P7 A S A S S P8 A A A A A P9 S S S NC S P10 A A A A S P11 NC NC S S NC Tot. A 8 8 9 8 4 Tot. S 2 2 2 2 6 Tot. NC 1 1 0 1 1 As shown in Figure 3(a), table exercises were also perceived as the most diicult ones � = (2.91, �� = 1.04) . Indeed, keyboard (� = 4.45, �� = .93), selection (� = 4.36, �� = 1.21), baskets (� = 4.55, �� = .82), and drag (� = 4.27, �� = 1.35) exercises all had signiicantly lower perceived diiculty � = 23.05,( � < .001), based on Friedman test and post hoc Dunn test with Bonferroni correction (all pair � <wise .05). No signiicant diferences were found between other exercise families. For all the exercise families, the perceived appreciation was high (see Figure 3(b)). The lowest scoring one was drag (� = 3.55, �� = 1.13) and the highestselection (� = 4.45, �� = .52). No signiicant diferences were found between the exercise families considering this metric. 4.2.2 System Usability. The average SUS score, measured on the participants’ responses, was.79 09 (�� = 11.20). This score is considered excellent, based on benchmarks available in prior 7literatur ]. It is also e [ higher than the average (72) for educational mobile apps 64].[Considering the separate SUS items (see Figure 4), all had better scores than the average reported in prior benchmarks 37[]. Only the last item had a score worse than the benchmark score. This item corresponds to the following statement: łI needed to learn a lot of things before I could get going with the systemž. This is not surprising given that the app’s goal is to teach literacy skills and We report means for multipoint items as they were found to better indicate central tendency than medians [35]. ACM Trans. Access. Comput. WordMelodies • 11 low low high high keyboard keyboard selection baskets drag table selection baskets drag table (a) Ease of use (b) Appreciation Fig. 3. Ease of use and Appreciation for diferent exercise families disagree agree Needed to Would use Unnecessarily Easy Would need Well Too much Quick Cumbersome Felt learn a lot frequently complex to use tech support integrated inconsistency to learn to use confident Fig. 4. System Usability Scale - separate scores for each item touchscreen interactions to the users. However, we also note that, despite this, participants did not feel that they needed technical support to use the app, and they found the app easy and quick to learn. Considering separate SUS scores for each participant, we notice that lowest scores were reported by those participants who required assistance most or could not solve some exercises. Indeed, P9, who could not complete one exercise family drag ( ) and needed support with all others had assigned a SUS score of 70 to the app. P11, who needed assistance with baskets and drag exercises, and could not complete all the other exercises assigned an even lower SUS score of 52.5. 5 REMOTE USAGE DATA ANALYSIS In addition to the user study, we also conducted remote usage data collection, which ran between April 2020 and December 2021, for a total of 21 months. During the data collection, we publicised the app to associations ACM Trans. Access. Comput. 12 • of people with VIB, teachers of children with VIB, and through blogs for accessible learning for people with VIB [21]. Data from the user studies, described in the previous section, was omitted from the remote usage data analysis. The data was collected anonymously. It included information about the platform used (device model and OS), related system settings (if the screen reader was active, language in use) and information about the app functionalities used, including screens visited and exercises performed by the user. For the exercises, we collected information about the exercise family and type, and whether the user performed the exercise correctly and after how many attempts. In totalWordMelodies has been used by 408 unique users. Most (280, 69%) started using the app within the irst two months from the publication, while the app was actively publicised. Of these, 79 (28%) stopped using the app shortly afterwards, which is in agreement with normal app abandonment behavior 40]. Instead, [ the majority (211, 72%) continued accessing the app in the following months. During the data colle , 489 ction, log 29 records were registered. Half of these,(822) 14 were collected within the irst two months from the publication of the app. 5.1 App Usage by Device Type and Model With 276 (68%) users in total, iOS devices were more commonly used. This was expected because iOS devices are generally more popular among people with VIB 48].[However, Android was in use on 32% of the devices (132). This is more than we expected based on prior literature, which suggest that iOS users with VIB are about 80% of the total [25]. The majority of the users accesseW d ordMelodies from a smartphone (223, 55%), while 185 (45%) used tablets. However, tablet usage was higher than expected considering that smartphones are much more common than tablets (about 10 to 1 proportion)59[]. In particular, iOS users favored tablets, with 162 (59%) using iPads, and 111 (41%) using iPhones. Instead, only 20 (15%) Android users accesse WorddMelodies from a tablet, while 112 (85%) used a smartphone. Another interesting inding is that many of the iOS devices were quite dated: 32 (29%) iPhone users and 89 (55%) iPad users had a device older than 2017. 5.2 User Characteristics 366 (90%) users accessed WordMelodies in English and 42 (10%) in Italian. This was expected as the app was publicised more actively on English websites 21] and [social networks. Of the 42 Italian-speaking users, 30 (71%) also tried English exercises. This result highlights the need to also exercise foreign language literacy, which is reported as a challenge for children with VIB [20]. During the data collection, the app was publicised with associations, teachers and web communities of people with VIB. While we cannot be certain, we therefore expect that most users were people with VIB. Of those who used the app, 329 (81%) users never used the screen reader, 37 (9%) used it sometimes and 42 (10%) users always had it active. This conirms prior indings that only a small portion of mobile users with VIB actually use the screen reader [30]. Only 6 (8%) screen reader users were on Android, and 2 of them used the screen reader only sporadically. This conirms that blind users (more in general screen reader users) prefer iOS over Android [48]. 5.3 Functionalities Used Among the collected log records, the majority marked exercise starts , 254, (10 35%). However, only one third of the exercises (,3144) were completed. The others were started but never inished. We expected this behavior to be indicative of new users, who would try out the app rather than diligently doing exercises. However, further analyses revealed that this behavior was consistent for both new and regular users. One possible way to explain this behavior is that the users "browse" diferent exercises, starting them and exiting immediately, until they ind the ones they are interested in. ACM Trans. Access. Comput. WordMelodies • 13 Attempted multiple times Completed at first try Complete the Listen and Drag the word Drag the word Select the Write the letter sight words complete the to complete into the rhyming word of the alphabet sentence the sentence correct basket in the box Fig. 5. Frequently completed exercises, at first try and repeated at least once (English) 7797 (26%) log records were associated to menu navigation, such as exercise or topic selection, while there were 545 (2%) accesses to tutorial exercises, of which 42 (8%) referred to the drag&drop functionality. Tutorials were activated by 188 (46%) diferent users, while the language selection functionality was accessed 365 (1%) times by 137 (34%) diferent users. However, only 30 users actually performed exercises in both languages. These were all users who irst performed some exercises in Italian, and then tried some exercises in English. 5.4 Exercises Of the 3144 exercises completed by the users, 2678 (85%) were in English and 466 (15%) in Italian. 40 of the 46 (87%) available English exercises were completed at least once. As shown in Figure 5, the most popular exercise was łWrite the letter of the alphabet in the boxž, solved 647 times (24%). This was also the irst exercise on the exercise list inside the app. Others were much less used: łSelect the rhyming wordž was completed 224 times (8%), łDrag the word into the correct basketž 215 (8%) times, łDrag the word to complete the sentencež 214 (8%) times, and łListen and complete the sentencež 147 (7%) times. It is worth noting that ł’Complete the sight wordsž, an English language-speciic exercise was the 6th most popular exercise, with 104 (4%) completions. The great variety of performed exercises, and the fact that the most popular exercise was the irst one on the list was probably due to new users exploring the app. For the Italian users, 24 out of 36 (67%) available exercises were completed at least once. Figure 6 shows the number of completions for the six most popular exercises. The most frequently completed exercise was łDrag the correct ending letterž, with 96 (20%) runs, followed by łDrag the word into the correct basketž, completed 76 (16%) times. łWrite the letter of the alphabet in the boxž, the irst exercise on the list, had a much lower count of 39 (8%) runs. łDrag the correct indeterminate articlež was completed 35 (7%) times, łIdentify the correct statementž 28 (6%) times, and łChoose the related words from the tablež 25 (5%) times. 2467 (78%) of the completed exercises were correct at irst try. Similar results were obtained for both English 2088 (78%) and Italian 379 (81%). Instead, 554 (22%) exercises were answered incorrectly and thus had to be repeated at least once, 485 (22%) for English and 69 (19%) for Italian. Most commonly, the repeated exercises were also the most popular ones. However, repetitions over total attempts varied across diferent exercises, and between the two languages. We note that the exercises belonging to table the family, which were the most diicult ones during the user study, also had a higher number of repetitions than the average: 33% in English and 25% in Italian. ACM Trans. Access. Comput. 14 • Among the most popular exercises in English, łSelect the rhyming wordž was the most frequently repeated one (61 times, 27%). łDrag the word to complete the sentencež was also repeated more than average (23%, 49). Other exercises were less frequent, with łWrite the letter of the alphabet in the boxž and łComplete the sight wordsž repeated 19% (125) and 18% (19) of the time, respectively. In Italian, łDrag the correct ending letterž was the exercise with most repetitions among the six most popular ones (26, 27%). All other popular exercises had less than average amount of repetitions. łChoose the related words from the tablež had 4 (16%), łWrite the letter of the alphabet in the boxž had 6 (15%), łDrag the word into the correct basketž had 11 (14%), and łIdentify the correct sentencež had 3 (11%). łDrag the correct indeterminate articlež was repeated in only 1 occasion out of 35 (2%). The analysis of the exercises that are frequently repeated could be indicative of which literacy skills require more training for the students in general. More speciically, educators, parents, and teachers can beneit from knowing which speciic exercises are more diicult for the children. 6 DISCUSSION AND LIMITATIONS 6.1 Drag&Drop Usability Drag&drop is known to be a problematic touchscreen interaction for people with VIB. This emerges in the scientiic literatur 34]eand [ was also reported by two of the domain experts during analysis. Instead, our results suggest that the drag&drop gesture inWordMelodies is accessible to children with VIB and does not impact the system usability. Indeed, most children completed the exercises with the drag&drop interaction without needing any support from the educator. We believe that such a positive result is due to the characteristics of our design of the interface elements and the interaction, which was reined through several iterations conducted with people with VIB. In our design, the elements are made to be as big as possible, with large text, distinctive colors and consistent behavior. This makes the draggable elements and drop areas easy to distinguish for people with low vision, and text content easy to read. For blind users, the interaction is coupled with explicative messages that clearly explain what the user is doing or can do with each interface element. Furthermor WordMelo e, dies implements a tutorial that provides step-by-step instructions on how to use the drag&drop gesture, which can be activated in each exercise that uses this interaction. Remote usage data analysis conirms that the tutorial functionality is indeed frequently used by app users and therefore could be a contributing factor to the accessibility of Drag&Drop exercises. Attempted multiple times Completed at first try Choose the Identify Drag the correct Write the letter Drag the word Drag the related words the correct indeterminate of the alphabet into the correct ending from the table sentence article in the box correct basket letter Fig. 6. Frequently completed exercises, at first try and repeated at least once (Italian) ACM Trans. Access. Comput. WordMelodies • 15 6.2 Dificulties in Performing Table Exercises Autonomously Study results show that the exercises in the table family were the hardest, with only four participants who completed them autonomously. Remote data conirmed this inding, indicating a higher than average number of repetitions for table exercises. This is interesting because this family of exercises requires a simple form of interaction i.e(., only element selection). So, one question emerges: what limits children autonomy in completing exercises in this family? Answering this question would require a new set of experiments but we can make the following hypothesis: the problems with these exercises emerged due to the large number of elements shown on the screen. Indeed, exercises in the table family are the only ones showing up to 16 interaction elements (the table cells). This can negatively impact the user experience of all users; for those with low vision, a larger number of elements means that each element is smaller, while for screen-reader users there is an additional diiculty in navigating among many items. We believe that providing additional messages during screen reader navigation to highlight the current position in the table, the selection status of the traversed elements and to list the currently selected elements would help screen reader users. Instead, for users with low vision, we could improve the size of the table with respect to the screen area, the color contrast of the table cells and the text, or provide zoom on the currently traversed element. Additional iterations to improve the design of the tutorial tablefor exer the cises could also help, as previously experienced for the Drag&Drop exercises. 6.3 Finding the Desired Exercise The analysis of the logs uncovers that users tend to start many exercises without completing them. We suspect that this is due to the fact that it is not immediate to ind one given exercise, hence users tend to start many, before inding the intended one. Currently the app presents a list of etopics .g., łLearn ( to writež) each containing a list of exercise types, some of which have multiple diiculty levels. One problem is that the list of topics is long (12 items in English) and many exercises could be suitable for more than one topic. Thus, it could be diicult for the user to ind the correct one. For example, the łlearn to writeł topic contains two exercise types but indeed most of the other exercise types are designed to support the user to łlearn to writež like those in the łalphabetž topic. So, one additional design requirement that we will address in future is that users should easily ind the exercise they intend to practice with. A number of solutions can be adopted to improve the system along this direction. It is possible to re-organize the exercises into more meaningful topics, and provide a preview image and a meaningful description of each exercise. It is also possible to implement a functionality to search for exercises by name or ilter them based on the child age or grade. Finally, it would be possible to deine preferred exercises or allow a caregiver to prepare a list of exercises (possibly of diferent types) that the child has to complete. 6.4 Edutainment App Localization In our previous work2[], we higlighted that exercises should be speciically designed to address linguistic skills required for each language. This is supported by the remote logging data analysis. Indeed, we note how popular exercises in English and Italian are diferent. Most importantly, we notice that language-speciic exercises, for example exercises on sight-words in English, are among the most popular ones. Furthermore, we also highlight that the majority of the Italian users of the app also accessed exercises in English. This is consistent with prior works that identify foreign language learning as a challenge for children with VIB20 [ ]. Based on this inding, we think W that ordMelodies could be an efective instrument for improving foreign language literacy. ACM Trans. Access. Comput. 16 • 7 CONCLUSIONS AND FUTURE WORK This paper presents the evaluation of W the ordMelodies mobile application 2] thr[ough a user study with 11 children, and the analysis of remotely collected usage logs. Results show that the app is usable, with a SUS score of 79, which is higher than other educational mobile apps and considered excellent based on prior benchmarks. The participants were autonomous in performing most of the exercises, even those based on the drag&drop interaction, which has so far been considered challenging for users with VIB. We achieved this result by carefully designing the interface elements and the screen reader messages provided while performing this interaction. Our design could be adapted to be used in other mobile applications, thus improving the accessibility of the Drag&Drop interaction in other mobile apps. We also uncover two key limitations of the current app. First, table theexercise family is found to be more diicult than the others, and often users need support to complete these exercises. Our intuition is that the users ind it diicult to visualize and navigate table exercises due to the presence of too many interactive elements. We discuss a number of possible design principles that could improve the accessibility of table exercises, but more generalizable indings, related to the accessibility of table content on touchscreens, could be drawn from a thorough future investigation. Another possible improvement is to provide more detailed instructions for the interaction with tables, similar to what we have done for the drag&drop exercises. We will also investigate alternative table exercises that are easier to answer than word association exercises. The second limitation is related to exercise selection; with the growing number of the exercises available inWordMelodies, the current list-based selection is not efective. We propose a number of solutions, aimed to simplify the search for a desired exercise, which we will explore as future work. Another major challenge that we wish to explore as a future work is the evaluation of the educational eicacy WordMelo of dies. We are planning to achieve this through a longitudinal study that involves multiple children, with and without VIB, and educators. Furthermore, other functionalities and personalization capabilities are also being investigated. As future work, we will expand the creation of exercises in other languages and we will investigate the use of the system for foreign language teaching. We are also working on a web-based dashboard for exercise creation and monitoring of the responses to support teachers during the use of the platform in classroom. Finally, we will include the support for the personalization of the app, including changing colors and verbal interaction messages. ACKNOWLEDGMENTS We wish to thank I.Ri.Fo.R. Pisa, and in particular Michele Materazzi for the invaluable support provided during the experiments. We also thank Diane Brauner for her precious insight during the conceptualization of the system. REFERENCES [1] Dragan Ahmetovic, Valeria Alampi, Cristian Bernareggi, Andrea Gerino, and Sergio Mascetti. 2017. Math Melodies: Supporting Visually Impaired Primary School Students in Learning Math. Proce Inedings of the 14th Web for All Conference on The Future of Accessible Work . ACM, 26. [2] Dragan Ahmetovic, Cristian Bernareggi, Irene Mantegazza, and Sergio Mascetti. 2021. WordMelodies: an Inclusive Mobile App Supporting the Acquisition of Literacy Skills. International In Web for All Conference . ACM. [3] Dragan Ahmetovic, Cristian Bernareggi, Sergio Mascetti, and Federico Pini. 2020. SoundLines: Exploration of Line Segments through Soniication and Multi-touch Interaction. ACMInSIGACCESS Conference on Computers and Accessibility (ASSETS). [4] APH. [n. d.]. Braille Buzz. https://www.aph.org/product/braille-buzz/. Accessed: 2022-01-29. [5] Dorit Aram and Orit Chorowicz Bar-Am. 2016. Mothers helping their preschool children to spell words: A comparison between interactions using the computer vs. pencil and pap International er. Journal of Child-Computer Interaction7 (2016), 15ś21. [6] Abraham Arcavi. 2003. The role of visual representations in the learning of mathematics. Educational studies in mathematics 52, 3 (2003), 215ś241. ACM Trans. Access. Comput. WordMelodies • 17 [7] Aaron Bangor, Philip T Kortum, and James T Miller. 2008. An empirical evaluation of the system usability Intl. Journal scale of. HumanśComputer Interaction 24, 6 (2008), 574ś594. [8] Florence Bara, Edouard Gentaz, and Dannyelle Valente. 2018. The efect of tactile illustrations on comprehension of storybooks by three children with visual impairments: An exploratorJournal y study.of Visual Impairment & Blindness112, 6 (2018), 759ś765. [9] Cristian Bernareggi, Dragan Ahmetovic, and Sergio Mascetti. 2019. MuGraph: Haptic Exploration and Editing of 3D Chemical Diagrams. In Conference on Computers & Accessibility. ACM. [10] Beth Beschorner and Amy C Hutchison. 2013. iPads as a literacy teaching tool in early childho International od. Journal of Education in Mathematics, Science and Technology 1, 1 (2013), 16. [11] Virginia Bower. 2011. Creative Ways to Teach Literacy: Ideas for Children Aged 3 to 11. Sage. [12] Deborah Chen and Jamie Dote-Kwan. 2018. Promoting emergent literacy skills in toddlers with visual impairments. Journal of Visual Impairment & Blindness 112, 5 (2018), 542ś550. [13] Common Core State Standards Initiative. 2010. Common core state standards for English language arts & literacy in history/social studies, science, and technical subjects, Appendix A. [14] CJ Craig. 1996. Family Support of the Emergent Literacy of Children with Visual Impairments. Journal of Visual Impairment & Blindness 90, 3 (1996), 194ś200. [15] Nicol Dalla Longa and Ornella Mich. 2013. Do animations in enhanced ebooks for children favour the reading comprehension process? A pilot study. In Proceedings of the 12th international conference on interaction design and children . 621ś624. [16] Frances Mary D’Andrea and Carol Farrenkopf. 2000.Looking to learn: Promoting literacy for students with low vision. American Foundation for the Blind. [17] Pauline Davis and Vicky Hopwood. 2002. Including children with a visual impairment in the mainstream primary school classroom. Journal of Research in Special Educational Needs2, 3 (2002), nośno. [18] Amy G Dell, Deborah A Newton, and Jerry G Petrof. 2012.Assistive technology in the classroom: Enhancing the school experiences of students with disabilities. Pearson Boston, MA. [19] Thomas Dick and Evelyn Kubiak. 1997. Issues and aids for teaching mathematics to theThe blind. Mathematics Teacher (1997). [20] Athanasia Efstathiou and Stavroula Polichronopoulou. 2015. Teaching English as a foreign language to visually impaired students: Teaching materials used by teachers of English. Enabling Access for Persons with Visual Impairment67 (2015). [21] Perkins eLearning. [n. d.]. Blog on WordMelodies. https://www.perkinselearning.org/technology/blog/word-melodies-emerging- reading-and-writing-app. Accessed: 2022-01-29. [22] Karen A Erickson and Deborah Hatton. 2007. Literacy and visual impairment. Seminars In in speech and language, Vol. 28. Copyright© 2007 by Thieme Medical Publishers, Inc., 333 Seventh Avenue, New ..., 058ś068. [23] William W Gaver. 1986. Auditory icons: Using sound in computer interfaces. Human-computer interaction 2, 2 (1986), 167ś177. [24] Andrea Gerino, Nicolo Alabastro, Cristian Bernareggi, Dragan Ahmetovic, and Sergio Mascetti. 2014. Mathmelodies: inclusive design of a didactic game to practice mathematics. International In Conference on Computers Helping People With Special Needs. Springer. [25] Nora Griin-Shirley, Devender R Banda, Paul M Ajuwon, Jongpil Cheon, Jaehoon Lee, Hye Ran Park, and Sanpalei N Lyngdoh. 2017. A survey on the use of mobile applications for people who are visually impair Journal of ed.Visual Impairment & Blindness111, 4 (2017), 307ś323. [26] Shayl F Griith, Mary B Hagan, Perrine Heymann, Brynna H Helin, and Daniel M Bagner. 2020. Apps as learning tools: a systematic review.Pediatrics 145, 1 (2020). [27] Kenneth A Hanninen and Aaster Raynor. 1975.Teaching the visually handicapped. Merrill. [28] Andrea Hathazi and Mihaela Bujor. 2013. Development of tactile strategies and use of tactile resources in emergent literacy at children with visual impairment. Psychologia paedagogia (2013), 41. [29] Italian Ministry of Education. 2004. Indicazioni Nazionali per i Piani di Studio Personalizzati nella Scuola Primaria. [30] Hernisa Kacorri, Sergio Mascetti, Andrea Gerino, Dragan Ahmetovic, Valeria Alampi, Hironobu Takagi, and Chieko Asakawa. 2018. Insights on Assistive Orientation and Mobility of People with Visual Impairment Based on Large-Scale Longitudinal Transactions Data. on Accessible Computing (2018). [31] Jeeeun Kim, Abigale Stangl, and Tom Yeh. 2014. Using LEGO to model 3D tactile picture books by sighted children for blind children. In Proceedings of the 2nd ACM symposium on Spatial user interaction. 146ś146. [32] Abhishek Kumar, K Vengatesan, M Rajesh, and Achintya Singhal. 2019. Teaching literacy through animation & multime International dia. Journal of Innovative Technology and Exploring Engineering8, 5 (2019), 73ś76. [33] Steven Landau and Karen Gourgey. 2001. Development of a talking tactile tablet. Information Technology and Disabilities7, 2 (2001). [34] Barbara Leporini and Eleonora Palmucci. 2017. A mobile educational game accessible to all, including screen reading users on a touch-screen device. InProceedings of the 16th World Conference on Mobile and Contextual Learning . 1ś4. [35] James R Lewis. 1993. Multipoint scales: Mean and median diferences and observed signiicance International levels. Journal of Human-Computer Interaction 5, 4 (1993), 383ś392. ACM Trans. Access. Comput. 18 • [36] James R Lewis. 2018. The system usability scale: past, present, and futur International e. Journal of HumanśComputer Interaction 34, 7 (2018), 577ś590. [37] James R Lewis and Jef Sauro. 2018. Item benchmarks for the system usability scale Journal . of Usability Studies13, 3 (2018). [38] Sandra Lewis. 2020. Education for students with visual impairments in the time of coronavirus: An approach to education through videoconferencing. , 171ś172 pages. [39] Sandra Lewis and Joan Tolla. 2003. Creating and using tactile experience books for young children with visualTimpairments. eaching Exceptional Children 35, 3 (2003), 22ś29. [40] Localytics. [n. d.]. 25% of Users Abandon Apps After One Use. https://uplandsoftware.com/localytics/resources/blog/25-of-users- abandon-apps-after-one-use/. Accessed: 2022-01-29. [41] Pedro Lopes, Alexandra Ion, Willi Mueller, Daniel Hofmann, Patrik Jonell, and Patrick Baudisch. 2015. Proprioceptive interaction. In Proceedings of the 33rd annual acm conference on human factors in computing systems . 939ś948. [42] Sergio Mascetti, Andrea Gerino, Cristian Bernareggi, and Lorenzo Picinali. 2017. On the evaluation of novel soniication techniques for non-visual shape exploration. ACM Transactions on Accessible Computing (TACCESS) 9, 4 (2017), 1ś28. [43] Sergio Mascetti, Giovanni Leontini, Cristian Bernareggi, and Dragan Ahmetovic. 2019. WordMelodies: supporting children with visual impairment in learning literacy ACM. In SIGACCESS Conference on Computers and Accessibility. ACM. [44] Carolane Mascle, Christophe Joufrais, Gwenaël Kaminski, and Florence Bara. 2022. Displaying easily recognizable tactile pictures: A comparison of three illustration techniques with blind and sighteJournal d childr ofen. Applied Developmental Psychology78 (2022), [45] Maureen McLaughlin and Brenda J Overturf. 2012. The common core: Insights into the Kś5 standarThe ds. Reading Teacher 66, 2 (2012), 153ś164. [46] Joshua A Miele, Steven Landau, and Deborah Gilden. 2006. Talking TMAP: Automated generation of audio-tactile maps using Smith- Kettlewell’s TMAP softwarBritish e. Journal of Visual Impairment24, 2 (2006), 93ś100. [47] Kathleen M Minke, George G Bear, Sandra A Deemer, and Shaunna M Griin. 1996. Teachers’ experiences with inclusive classrooms: Implications for special education rThe eform. Journal of Special Education30, 2 (1996), 152ś186. [48] John Morris and James Mueller. 2014. Blind and deaf consumer preferences for android and iOS smartphones. InclusivIn e designing. Springer, 69ś79. [49] Tauik Muhtarom et al . 2019. The urgency of Interactive Animated Learning Media Development for Facilitating Literate Skills for The Student of Primary School. Journal In of Physics: Conference Series , Vol. 1254. IOPublishing, 012034. [50] Michelle M Neumann and David L Neumann. 2017. The use of touch-screen tablets at home and pre-school to foster emergent literacy. Journal of Early Childhood Literacy17, 2 (2017), 203ś220. [51] Denis Nikitenko and Daniel Gillis. 2014. Touching the data: Exploring data soniication on mobile touchscr Procedia een devices. Computer Science 34 (2014), 360ś367. [52] ObjectiveED. [n. d.]. Braille Sheets. https://www.objectiveed.com/braille-sheets. Accessed: 2022-01-29. [53] Cynthia Putnam, Melisa Puthenmadom, Marjorie Ann Cuerdo, Wanshu Wang, and Nathaniel Paul. 2020. Adaptation of the system usability scale for user testing with childr Extende en. In d Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems . 1ś7. [54] Anne Spencer Ross, Xiaoyi Zhang, James Fogarty, and Jacob O Wobbrock. 2017. Epidemiology as a framework for large-scale mobile application accessibility assessment. ProceeIn dings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility . 2ś11. [55] Martin Schmitz, Mohammadreza Khalilbeigi, Matthias Balwierz, Roman Lissermann, Max Mühlhäuser, and Jürgen Steimle. 2015. Capricate: A fabrication pipeline to design and 3D print capacitive touch sensors for interactiv Proceeedings objects. ofIn the 28th Annual ACM Symposium on User Interface Software & Technology . 253ś258. [56] Lei Shi, Holly Lawson, Zhuohao Zhang, and Shiri Azenkot. 2019. Designing interactive 3D printed models with teachers of the visually impaired. Pr Inoceedings of the 2019 CHI Conference on Human Factors in Computing Systems . 1ś14. [57] Kristen Shinohara and Jacob O Wobbrock. 2011. In the shadow of misperception: assistive technology use and social interactions. In Conference on Human Factors in Computing Systems. ACM. [58] Abigale Stangl, Jeeeun Kim, and Tom Yeh. 2014. Technology to support emergent literacy skills in young children with visual impairments. In Proceedings of the extended abstracts of the 32nd annual ACM conference on Human factors in computing systems . ACM, 1249ś1254. [59] Statcounter. [n. d.]. Desktop vs Mobile vs Tablet Market Share Worldwide. https://gs.statcounter.com/platform-market-share/desktop- mobile-table. Accessed: 2022-01-29. [60] Edward Steinfeld and Jordana Maisel. 2012. Universal design: Creating inclusive environments. John Wiley & Sons. [61] Josephine M Stratton and Suzette Wright. 1991. On the Way to Literacy: Early Experiences for Young Visually ImpairedRE: Children. view 23, 2 (1991), 55ś62. [62] Sensory Sun. [n. d.]. Exploring Braille with Madilyn and Ruf. https://www.sensorysun.org/apps/. Accessed: 2022-01-29. [63] Ann P Turnbull et al. 1995.Exceptional lives: Special education in today’s schools. ERIC. ACM Trans. Access. Comput. WordMelodies • 19 [64] Prokopia Vlachogianni and Nikolaos Tselios. 2021. Perceived usability evaluation of educational technology using the System Usability Scale (SUS): A systematic revieJournal w. of Research on Technology in Education(2021), 1ś18. [65] David Wray, Richard Fox, Jane Medwell, and Louise Poulson. T2002. eaching literacy efectively in the primary school. Psychology Press. [66] Dominic Wyse, Russell Jones, Helen Bradford, and Mary Anne Wolpert. T2018. eaching English, language and literacy. Routledge. [67] Wai Yu, Ramesh Ramloll, and Stephen Brewster. 2000. Haptic graphs for blind computer users. International In Workshop on Haptic Human-Computer Interaction. Springer. ACM Trans. Access. Comput. http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png ACM Transactions on Accessible Computing (TACCESS) Association for Computing Machinery

WordMelodies: Supporting the Acquisition of Literacy Skills by Children with Visual Impairment through a Mobile App

Loading next page...
 
/lp/association-for-computing-machinery/wordmelodies-supporting-the-acquisition-of-literacy-skills-by-children-ssPGwJUQ2N

References

References for this paper are not available at this time. We will be adding them shortly, thank you for your patience.

Publisher
Association for Computing Machinery
Copyright
Copyright © 2023 Copyright held by the owner/author(s). Publication rights licensed to ACM.
ISSN
1936-7228
eISSN
1936-7236
DOI
10.1145/3565029
Publisher site
See Article on Publisher Site

Abstract

WordMelodies: Supporting the Acquisition of Literacy Skills by Children with Visual Impairment through a Mobile App DRAGAN AHMETOVIC, Università degli Studi di Milano, CRISTIAN BERNAREGGI, Università degli Studi di Milano, BARBARA LEPORINI, Istituto di Scienza e Tecnologie dell’Informazione, CNR, SERGIO MASCETTI, Università degli Studi di Milano, WordMelodies is a mobile app that aims to support inclusive teaching of literacy skills for primary school students. Thus it was designed to be accessible both visually and through screen reader, and it includes over 80 diferent types of exercises for practicing literacy skills, each with adjustable diiculty levels, in Italian and in English. WordMelodies is freely available for iOS and Android devices. However, it has not been previously evaluated with children having visual impairments. Thus, in this paper, we evaluate the app usability, its perceived ease of use, appreciation and children’s autonomy while using it, as well as the characteristics of the end users. To achieve this, we conducted a user study with 11 primary school students with visual impairments, and we analyzed app usage logs collected from 408 users in over one year from the app publication. We show that app usability is high, and most exercises can be completed autonomously. The exercises are also perceived to be easy to perform, and they are appreciated by the participants. Finally, we provide insights on how to address the identiied app limitations and propose future research directions. CCS Concepts: · Human-centered computing → Accessibility; · Applied computing → Interactive learning environments; · Social and professional topics → K-12 education. Additional Key Words and Phrases: Visual impairment, Literacy education, mobile edutainment apps. 1 INTRODUCTION Primary school teaching materials, both print-base e.g., dte(xtbooks) and digital e.g.(, educational apps), often use graphical content as a means to engage very young students. Additionally, illustrations are also used to convey complex concepts, for example in geometry or mathematics 6]. The [ illustrations also provide the bridge between listening and early reading behavior 39], and [ therefore they are also invaluable for the early formation of literacy and phonemic skills. However, such materials may not be accessible for children with severe visual impairments or blindness (VIB) [27]. For these children, the lack of adequate teaching materials is a critical limitation for the development of literacy skills 12, 22[]. While accessible alternatives, such as braille18b]oor okstactile [ drawings 39],[ exist, these have a number of limitations. They are diicult to design and produce, they are commonly available only in special education settings 17],[but rarely present among the resources of inclusive classes 47], and [ they are not inclusive to sighted students, which may contribute to social exclusion of students with VIB [57]. Authors’ addresses: Dragan Ahmetovic, dragan.ahmetovic@unimi.it, Università degli Studi di Milano, ; Cristian Bernareggi, cristian. bernareggi@unimi.it, Università degli Studi di Milano,; Barbara Leporini, barbara.leporini@isti.cnr.it, Istituto di Scienza e Tecnologie dell’Informazione, CNR,; Sergio Mascetti, sergio.mascetti@unimi.it, Università degli Studi di Milano, Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for proit or commercial advantage and that copies bear this notice and the full citation on the irst page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior speciic permission and/or a fee. Request permissions from permissions@acm.org. © 2022 Copyright held by the owner/author(s). Publication rights licensed to ACM. 1936-7228/2022/10-ART $15.00 https://doi.org/10.1145/3565029 ACM Trans. Access. Comput. 2 • To address these issues, we presentWordMelodies [2, 43], a mobile application to support children in the acquisition of basic literacy skills. The app was designed to be inclusive for children with and without VIB, thus promoting interaction between them. WordMelodies also supports children in exercising basic touchscreen interactions on mobile devices, thus promoting digital literacy as well. The app design involved teachers of children with visual impairments and accessibility specialists, through multiple, user-driven iterations, with a universal design60 appr ]. Curr oachently [ , it features over 80 diferent, language-speciic exercises, in English and Italian languages, with 5 unique exercise families, each with a diferent interaction modality Wor.dMelodies was developed as a cross-platform software, and it was published for free 1 2 on mobile app stores for both Android and iOS platforms . The app was publicised through associations of people with VIB, during classes with children with VIB, and through blogs for accessible learning for people with VIB [21]. We previously presented a preliminary evaluation conducted with adults with visual impairments to assess app usability and accessibility 2]. Study [ results unveiled that the app is indeed accessible and usable by people with VIB. After the publication we also initiated anonymous remote collection of app usage data, aiming to investigate how end users interact with the system. 1.1 New Contributions This paper extends our prior work 2],[ presented at the 18th International Web For All Conference, with two additional key contributions: • Our conference paper presented a limited user study with 4 adults with visual impairments, aimed only at assessing the app accessibility and usability. In this extension we present the results of a user study conducted with 11 children with VIB that use WorddMelodies under the supervision of an educator. The focus of the study is to evaluate the usability of the system perceived by children, and to assess whether the ive proposed exercise families are perceived by the educators to be easy to use, appreciated and suitable for autonomous usage by the children. • During our prior work we initiated remote collection of usage data from end users, reporting only basic statistics on the irst month of the collected data. After over a year of collecting data, we analyze it to improve our understanding of: a) the adoption of the system, considering user language, the device used, and screen reader usage b) exercise usage, in particular considering usage frequency, error frequency and distribution by types of exercises, user language, and screen reader usage. Results of our user study show thatWordMelodies is perceived to be highly usable by the children, with an average System Usability Scale (SUS) 36, [53] score of 79. Most participants were also able to complete the exercises without assistance, including exercises based on the drag&drop interaction. This is notable because this form of interaction is known to be particularly challenging for users 34].with Since VIBthe [ drag&drop interaction was particularly successful we provide some details on how we designed it. Most exercises were considered easy to use and were appreciated by the participants. However, exercises involving the selection of multiple elements in a table were perceived to be more diicult to perform autonomously. Indeed, 6 participants had to be assisted and one did not manage to complete these exercises at all. The diiculties with table exercises might be associated to the high number of elements that need to be explored, and the need to keep track of those elements that have been selected. Through remote logging, we collected usage data from 408 users. The participants had an explorative behavior, accessing many exercises before choosing the one to solve. This indicates that the exercise selection interaction should be modiied to make it easy for the users to ind the intended exercise. Another inding is that Italian https://play.google.com/store/apps/details?id=com.wordmelodies https://apps.apple.com/it/app/id1495831516 ACM Trans. Access. Comput. WordMelodies • 3 users also tried exercises in English, showing that the app could be useful for learning foreign language literacy. Language-speciic exercises were also among the most commonly used ones, indicating that correct localization and internationalization of exercises is a top priority. Errors in exercises were uneven, indicating that some exercises might require more training to develop the associated literacy and interaction skills. 2 RELATED WORK 2.1 Development of Literacy Skills in Sighted Students and Students with VIB Primary school teaching materials for developing literacy skills often rely on illustrations65and ] visual cues [ because visual reminders support the early formation of literacy and phonemic 39].skills Thus, similar [ learning activities are invaluable to engage students and to support the understanding of more complex concepts 11, 66]. [ Moreover, in the last decades, there has been extraordinary growth in the use of animations and multimedia [15, 32, 49] to teach literacy skills. In recent years, an increasing number of mobile device applications have been proposed for teaching basic literacy skills through gamiication 10, 26].[Such solutions have been adopted in primary school programs as well as in homework activities to foster emergent literacy 5, 50 skills ]. Indee[d, research indings indicate that preschoolers and students in early classes of primary school show signiicantly higher basic literacy skills (e.g., letter name and sound knowledge, print concepts, name writing skills) after hours of exposure to similar edutainment games [26]. Prior literature suggests that similar sensory and interactive strategies are needed also for children with VIB to support the development of oral language and literacy 12, 22 [ ]. Indeed, while family support can to some degree improve the literacy skills in children with 14], prior VIB [ works suggest that irst hand experience with literacy exercises is needed for promoting literacy among children with 61]. Ho VIB we[ver, visual-based educational strategies and technologies, adopted to teach literacy to sighted young students, are not accessible without sight. Thus, they are not adequate to engage and teach the same concepts to students with severe VIB [16, 27]. 2.2 Education Materials for Students with VIB Printed teaching materials, and in particular those that use illustrations, are not accessible to students with severe VIB [19]. For these students, accessible solutions, such as Braille books or tactile drawings, are often used [18]. These solutions are an efective support for teaching activities aimed at children with 17se ]. vere VIB [ However, such instruments are rarely available outside special education47classes ]. Typically [ , tactile materials are also diicult to produce since illustrations are complex to render non-visually 19]. Therefor [ e they are seldom available for children with severe17VIB , 27].[ Furthermore, tactile materials cannot be modiied once created and their interactivity is limited. Additionally, tactile materials are commonly designed solely for the support of people with VIB, without considering the inclusiveness and collaboration with other 63],childr whichen can[ potentially lead to social exclusion [57]. Similarly to printed materials, digital teaching materials also use visual interactions, animations and drawings to stimulate learning, which often makes them inaccessible to students with se54 ver , 58 e VIB ]. To[address this issue, approaches using haptic devices to access graph data have been investigate 9, 67].dHo [ wever, these devices are uncommon and haptic representations need to be speciically designed. Approaches based on touchscreen interactions on mobile devices have also been proposed. These solutions can convey spatial information through the proprioceptive exploration of the touchscreen surface 41]. The [ y have been used to convey mathematical concepts [24], learn simple shapes 3,[42] or visualize graph data 51].[ Such approaches are convenient because commodity devices can be used, they are highly interactive, and they are also inclusive since visual representations can be associated to non-visual touchscreen exploration. ACM Trans. Access. Comput. 4 • Tactile materials, augmented with digital interactions to increase their interactivity, have also been investigated. One possible solution are 3D printed models embedding touch sensors 55]. Other [ approaches detect interaction using computer vision detection through external devices 56]. These [ solutions, however, are complex to design and produce. Approaches using tactile overlays for touchscreen devices 33, 46[] mitigate the production costs required for 3d printed models. They are more inclusive as visual touchscreen access is still possible, and overlays can be easily swapped. However, the overlays still need to be carefully designed and printed. 2.3 Education Materials for Developing Literacy Skills in Students with VIB Prior literature stresses the importance of using adequate materials to support emergent literacy in children with VIB28 [ , 61]. However, only few works propose education materials for this16 goal ]. An[ exploratory study reports positive efects of tactile illustrations on storybook comprehension by children 8].with One prior VIB [ work [61] describes a speciic program developed by the American Printing House for the Blind which includes a handbook and 27 tactile-visual read-aloud story books. Others propose design and usage guidelines for tactile materials, indicating advantages in supporting emergent literacy skills for children with VIB [31, 39, 44]. To date, very few digital solutions support emergent literacy in children with VIB. The lack of accessible digital teaching materials is particularly relevant in situations that require remote teaching, without being able to use materials available in class, as during the school lock-down due to the COVID-19 pandemic 38]. [ Considering mobile applications, most of those available for children with VIB are designed to teach basic Braille literacy: Exploring Braille with Madilyn and Ruf [62], Braille Buzz [4], and Braille Sheets [52]. Even though these applications support Braille literacy, they are limiteExploring d in scopBraille e. with Madilyn and Ruf and BrailleBuzz are speciically designed for early-stage braille learning, and in particular they teach how to identify and produce single Braille letters. Braille Sheets can be used with pre-printed Braille sheets superimposed on an iPad touchscreen. This solution is limited due to the type of interaction with the pre-printed braille sheets, which does not allow the student to interact with the iPad in the same way that their sighted peers are interacting with literacy gamese.g. ( , literacy exercises based on drag&drop, complete the word with missing letters, unscramble words, delete the wrong letter, and so on). 3 SYSTEM DEVELOPMENT The idea behind WordMelodies was suggested by a teacher for children with VIB from USA who reported that there is a lack of accessible apps to practice literacy skills for primary school children. Guided by this observation, the research team started the app development with an iterative design process. The design involved two iterations with educators for children with VIB, accessibility experts, and researchers. In the following we report the main design principles, identiied after the two iterations, the strategies adopted to implement these principles, and the key characteristics of the inal app. Additional details on each iteration can be found in our previous paper [2]. 3.1 Problem Analysis We irst aimed to identify which exercises could be more efective in supporting the learning of children with VIB. For this, we created a list of 56 possible exer,cises deined based on current teaching standards13[, 29, 45], existing educational apps (most of which were inaccessible), and informal interviews with three domain experts: the same teacher who reported the problem, a congenitally blind expert in assistive technologies (a co-author of this paper), and a primary school teacher from Italy. After creating the list of the potential exercises, we presented each exercise to two of the domain experts, also providing an example of how children with VIB could interact with the app while performing the exercise. Then, we asked the experts to specify, for each presented exercise, a subjective evaluation of the exercise usefulness, https://wmel.netlify.app/ ACM Trans. Access. Comput. WordMelodies • 5 and optionally to provide additional comments. The results of this formative activity were used, in the following development phases, to select which exercises to implement within the app. Informal interviews with the two domain experts were also conducted to elicit key design principles that were then used to guide the app engineering and implementation. The design principles that were identiied are: • Inclusiveness. The app should be usable by both sighted children and children with VIB. • Entertainment. To engage and keep the children interested the app should be entertaining. • Independence. Children should be able to use the app also without supervision by adults. • Consistency. Interactions and interfaces should be consistent among diferent exercises. For example, interactive elements having the same functionality should have the same colors and positions in all the screens. The interactive elements should possibly be close to the screen corners. • Beyond tap. Interviews with the domain experts highlighted that the app should help children to exercise common yet complex interaction gestures, like drag&drop. This is the opposite of the łsimple gesturež principle adopted in similar applications [1, 24]. • Scalability. New exercises should be easy to create. • Multi-platform. To reach all potential users, the application should be available for all mobile systems (iOS and Android) and device form factors (smartphones and tablets). 3.2 Design To implement the outlined design principles, WordMelodies adopts a number of strategies, the most important being the following : (1) To enable inclusive and entertaining interactions WordMelodies adopts speciic design principles to support visual access, as well as the accessibility by people with low vision and screen-reader users. Speciically, to support access by people with low vision, WordMelodies uses large text, high contrast visual elements, and consistent color coding. Furthermore, system accessibility services, such as zoom and negative color ilter can also be used. To support inclusive access to blind people, people with low vision, and sighted people Wor,dMelodies uses audio-icons 23[], interface elements which combine visual and auditory aspects and interactions. Indeed, all interactive elements are accessible by hearing and sight. Consider the example in Figure 1(a): upon touching the picture of the lion, the audio of its roar is played. Then, when the child slides the inger among the letters on the touchscreen, if the screen reader is active, it reads each letter and a corresponding word to support the comprehension of the letter e.g.,(łI for icež). (2) To support children in learning and exercising common touchscreen interactions WordMelodies deines 5exercise families, each requiring a diferent interaction. The way to interact with each exercise is explained through a tutorial that can be accessed from the exercise itself. Furthermore, carefully designed verbal messages are provided during the interaction explaining each step of it. The ive exercise families are presented in detail in following section. (3) To ease scalability and consistency, the ive exercise families can be used as a template to create many diferent exercises having a common interaction mode. For example łselect the antonymž (see Figure 1(d)) and łselect the rhymež are diferent exercise types in the same family. With this approach, diferent educational goals can be pursued with the same interaction, hence increasing consistency. This approach also eases scalability. Indeed exercise families are implemented so that exercises for each family are deined in a static ile. Hence, adding new exercises within the same family does not require writing additional code, only extending the static ile. see our previous paper [2] for the full list ACM Trans. Access. Comput. 6 • 3.3 Exercise Families CurrentlyWordMelodies deines ive exercise families (see Figure 1), with a total of 82 exercise types (46 in English and 36 in Italian). The ive exercise families are: • drag (drag the correct element). Exercises in this family require the child to drag one or more elements to one or more destination areas. Hints can be provided in the form of an audio-icon or a word that is read aloud. In the example in Figure 1(a) there is an audio-icon representing a lion and the letters łL", blank space, łOž, łNž. In the line below, there are three draggable letters łI", łE", łO". Another exercise in the same family is łreorder the letters in the alphabetž (see Figure 2) in which there are three empty spaces and three letters (i.e., draggable elements) to reorder. • keyboard (write with software keyboard). In these exercises the child has to insert one or more letters selecting them from a simpliied soft keyboard. Hints can be provided in the form of an audio-icon or a text that is read aloud. In the example of Figure 1(b) upon touching the speaker icon the text łI for icež is read aloud. Then, the child has to insert the right letter in the box. Another exercise in the same family requires the child to complete a word by inserting the right letters into a list of empty boxes (e.g., to write the dogž ł word). • baskets (drag an item to the correct basket). Exercises in this family present one element in the screen center that should be dragged to the right target on the left or the right of the screen. The example of Figure 1(c) shows the element duchessž ł that should be dragged over the łmalež or łfemalež targets. Another exercise in the same family requires to distinguish between nouns and verbs. • selection (select the correct answer). In these exercises the child has to select the correct answer from a set of possible answers by tapping it. In the example of Figure 1(d) the child has to select which is the antonym of diicultž ł selecting among easyž ł , łhardž, łjoyž. Another exercise in the same family requires the child to select the word (in a set of three) that rhymes with a given word. • table (select multiple answers in table). In this exercise the child has to select, by tap, one or more answers from a set of possible ones, and then press done ł .ž The exercise is correct if all the related elements (which can vary in number) were selected. For example, in Figure 1(e) the child has to select all the words related to the word łbeachž. There are nine choices, ive of which are relate e.g. d,(łwave,ž łsandž) , and four are not (e.g., łgirafe,ž łtelevisionž). 3.4 Drag&Drop Design Learning and performing the Drag&Drop interaction on touchscreen via screen reader is known to be diicult for people with VIB34[]. In this interaction the users irst select the target object to move, by exploring the touchscreen surface with the inger or by swiping left/right to sequentially traverse the available objects. Then they perform a double tap and hold the inger on the screen to start dragging the selected element. This latter gesture is independent from the position of the selected element on the screen. Then, the users can drag the inger on the screen, thus moving the selected element and receiving indications of the areas traversed. However, in the default implementation of this interaction it is not clear whether an element can be dragged, whether a traversed area is an eligible target area, and whether the target area is already occupied. We describe the design principles that we adopted to improve the accessibility of this type of interaction in the drag family exercises. Note that the following design principles do not apply baskettofamily the exercises as they have a much simpler interaction e.g., (there is only one draggable element and two eligible areas that cannot be occupied). Speciically, we implemented personalized solutions for people with low vision and for screen-reader users. For users with low vision, we made sure that all interactive elements are clearly distinguishable. Speciically, the draggable objects are all highlighted in ochre yellow, the target areas are painted in light grey, the starting ACM Trans. Access. Comput. WordMelodies • 7 (a) Drag the correct element(s) (b) Write with software keyboard (c) Drag an item to the correct basket (d) Select the correct answer (e) Select multiple answers in table Fig. 1. Examples of exercises inWordMelodies from the five diferent exercise families. area of a dragged element is in dark grey, and the background is in light blue. While the ability to adapt the actual colors to the speciic users needs might be useful, we argue that the design principle of clearly distinguishing these elements eases the interaction. For screen-reader users we carefully designed a series of voice messages to be read during interaction (the following examples all refer to Figure 2): • draggable objects are indicated with an hint e.g., łO ( for Orange [pause] draggable elementž). • upon starting the drag gesture, the object being dragged is repeate e.g. d ,(łYou are moving O for orangež). • the user is informed when the dragged object enters a target area and if the target area is already occupied (e.g., łEmpty Box 1ž). • the user is informed when the dragged object leaves a target areea .g.,(łBox 1 left, release to cancelž). • the user is informed when the dragged object is placed in a targete.g. ar,eałO(for Orange placed in Box 1ž). ACM Trans. Access. Comput. 8 • Fig. 2. Drag&drop example (screenshot taken while the leter łOž was being dragged). We also limited the number of elements to drag to a maximum of 3. Since there are few elements, it is possible to represent them in large dimensions also on smartphone devices. In turn, this eases readability for people with low vision and simpliies interaction for screen-reader users. Finally, we highlight that the corresponding tutorial exercise was also carefully designed to explain how to perform the drag&drop gesture step-by-step. 4 USER STUDY In our previous work, we described the accessibility evaluation of the app, conducted with adults 2].with VIB [ Here, we describe a new study, conducted with a group of children with VIB, aimed at evaluating the app usability and assessing the participants’ perceived autonomy, ease of use and appreciation of the touchscreen interaction modalities implemented in the ive exercise families. The evaluation of the educational WordMelo eicacy dies of is beyond the scope of this paper. 4.1 Experimental Design 4.1.1 Participants. A group of children with VIB has been recruited by the Institute for Research, Training and Rehabilitation (I.Ri.Fo.R.), which is a foundation managed by the Italian Union for Blind and Visually Impaired People (UICI) to carry out speciic research, training and rehabilitation activities for people with VIB. All participants accessed the Italian version of the app. Participants’ demographic data is summarized in Table 1; łTS experiencež is the previous experience in the use of touch-screen, A ł T usedž is the assistive technology used during the experiment. Eleven participants with VIB (6 M, 5 F) with an age range between 5 and � 11 = 8(.91, �� = 2.34) participated in the study. Two children (P6 and P9) were blind, and the other 9 had severe visual impairment. The two participants who were blind,�and 5 who could not interact with the app visually, used the screen reader. All the other participants had suicient residual vision to be able to interact with the app visually, and therefore did not use any accessibility services (zoom, text enlargement, inverted colors). We believe that this is due to the fact thatWordMelodies already uses very large font and high contrast colors, as highlighted in Section 3.2. Most participants had frequent prior experience with touchscreen interaction (P1, P3, P4, P5, P8, P10), while two sometimes used touchscreen devices (P2, P6) and three never (P7, P9, P11). 4.1.2 Apparatus. The study was conducted at the I.ri.Fo.R. institute in Pisa. During the tests, the participants were supported by a typhloinformatics educator. For the study, an iPad air tablet with iOS 13 was used. For the three participants that needed it, VoiceOver screen reader was used. Data about the participants and the study was collected via questionnaires completed by the educator using digital documents. Participants’ demographic data were collected anonymously and included sex, age, visual condition, and self-reported touchscreen interaction experience (frequent, sometimes, never). Consent forms were ACM Trans. Access. Comput. WordMelodies • 9 Table 1. Participants’ demographic data. AT: Assistive technology, TS: Touchscreen PID Sex Age Visual condition TS experience AT used P1 F 8 Low vision Frequent None P2 F 10 Low vision Sometimes None P3 F 10 Low vision Frequent None P4 M 11 Low vision Frequent None P5 M 11 Low vision Frequent VO P6 M 11 Blind Sometimes VO P7 M 5 Low vision Never None P8 F 9 Low vision Frequent None P9 M 7 Blind Never VO P10 M 11 Low vision Frequent None P11 F 5 Low vision Never None collected for each participant. For each exercise family, we collected the educator’s assessment of the participant’s autonomy in performing the exercise (autonomous, supported, not-completed), as well as the ease of use and appreciation of the exercise with values on a 1-5 scale where 1 and 5 indicated low and high ease of use or appreciation respectively. We also assessed the usability of the app through a version of the System Usability Scale (SUS) [36] adapted for use with children [53]. 4.1.3 Protocol. Before the study, the educator described the study to the child’s parents and had them sign the study consent form. Afterwards, demographic data was collected for the participant performing the test. The educator then introduced the app to the participant and initiated the study tasks. A set of 5 tasks has been deined for the user test, one for each exercise family. Each task included a series of 4 exercises of the same type. Speciically, the tasks were: • keyboard, alphabet: write the correct letter of the alphabet in the box. • selection, rhymes: select the word rhyming with a given word. • baskets, vowels and consonants: drag the letter in the correct basket. • drag, articles: drag the correct determinative article in the box. • table, proper nouns: select proper nouns in the table. The irst exercise was used to show the participant how the interaction in the considered exercise family works and it was not considered in the following data analysis. The participant was then asked to perform the other 3 exercises autonomously. This procedure was replicated for each task. Thus, a total of 20 exercises were performed by every participant, of which 15 were observed and considered for data analysis purposes. The study took about 30 minutes for each participant. The educator was asked to observe the participant when performing the tasks and to take notes while the user was interacting with the exercises on the touchscreen. More speciically, the educator was asked to: (1) take note of the start and end date/time of the test for each participant. (2) take note of any diiculties the children encountered in performing the exercises. (3) take note of whether the tasks were completed, and how (independently or with support). For each task, the educator also assessed, on a Likert scale from 1 to 5, the ease of use and the perceived appreciation by the participant, for the considered exercise. After all the tasks, the participant was also asked an adapted version of the System Usability Scale (SUS) questionnair 36], designe e [ d to be suitable for childr 53en ]. [ ACM Trans. Access. Comput. 10 • 4.2 Results 4.2.1 Autonomy, Ease of Use, and Appreciation of Diferent Exercise Families.For most exercise families, the participants were able to solve the exercises autonomously (see Table 2). 9 participants were abledrag to solve exercises autonomously, while 2 (P9, P11) required assistance Keyboar . d, selection, and baskets exercises were solved autonomously by 8 participants each. ke Foryboard, P2 and P9 required assistance, and P11 could not complete the exercises. This participant could not complete selection exercises as well, while P7 and P9 required assistance with them. Instead, for drag exercise family, P7 and P11 required assistance while P9 did not manage to complete them autonomouslyT . able was the most problematic exercise family, with only 4 participants (P2,P3,P5,P8) who were able to solve them on their own. Among the others, 1 participant could not complete these exercises (P11) and the remaining 6 required assistance. Table 2. Exercise families completed autonomously (A), with support (S) or not completed (NC) PID Keyboard Selecting Baskets Drag Table P1 A A A A S P2 S A A A A P3 A A A A A P4 A A A A S P5 A A A A A P6 A A A A S P7 A S A S S P8 A A A A A P9 S S S NC S P10 A A A A S P11 NC NC S S NC Tot. A 8 8 9 8 4 Tot. S 2 2 2 2 6 Tot. NC 1 1 0 1 1 As shown in Figure 3(a), table exercises were also perceived as the most diicult ones � = (2.91, �� = 1.04) . Indeed, keyboard (� = 4.45, �� = .93), selection (� = 4.36, �� = 1.21), baskets (� = 4.55, �� = .82), and drag (� = 4.27, �� = 1.35) exercises all had signiicantly lower perceived diiculty � = 23.05,( � < .001), based on Friedman test and post hoc Dunn test with Bonferroni correction (all pair � <wise .05). No signiicant diferences were found between other exercise families. For all the exercise families, the perceived appreciation was high (see Figure 3(b)). The lowest scoring one was drag (� = 3.55, �� = 1.13) and the highestselection (� = 4.45, �� = .52). No signiicant diferences were found between the exercise families considering this metric. 4.2.2 System Usability. The average SUS score, measured on the participants’ responses, was.79 09 (�� = 11.20). This score is considered excellent, based on benchmarks available in prior 7literatur ]. It is also e [ higher than the average (72) for educational mobile apps 64].[Considering the separate SUS items (see Figure 4), all had better scores than the average reported in prior benchmarks 37[]. Only the last item had a score worse than the benchmark score. This item corresponds to the following statement: łI needed to learn a lot of things before I could get going with the systemž. This is not surprising given that the app’s goal is to teach literacy skills and We report means for multipoint items as they were found to better indicate central tendency than medians [35]. ACM Trans. Access. Comput. WordMelodies • 11 low low high high keyboard keyboard selection baskets drag table selection baskets drag table (a) Ease of use (b) Appreciation Fig. 3. Ease of use and Appreciation for diferent exercise families disagree agree Needed to Would use Unnecessarily Easy Would need Well Too much Quick Cumbersome Felt learn a lot frequently complex to use tech support integrated inconsistency to learn to use confident Fig. 4. System Usability Scale - separate scores for each item touchscreen interactions to the users. However, we also note that, despite this, participants did not feel that they needed technical support to use the app, and they found the app easy and quick to learn. Considering separate SUS scores for each participant, we notice that lowest scores were reported by those participants who required assistance most or could not solve some exercises. Indeed, P9, who could not complete one exercise family drag ( ) and needed support with all others had assigned a SUS score of 70 to the app. P11, who needed assistance with baskets and drag exercises, and could not complete all the other exercises assigned an even lower SUS score of 52.5. 5 REMOTE USAGE DATA ANALYSIS In addition to the user study, we also conducted remote usage data collection, which ran between April 2020 and December 2021, for a total of 21 months. During the data collection, we publicised the app to associations ACM Trans. Access. Comput. 12 • of people with VIB, teachers of children with VIB, and through blogs for accessible learning for people with VIB [21]. Data from the user studies, described in the previous section, was omitted from the remote usage data analysis. The data was collected anonymously. It included information about the platform used (device model and OS), related system settings (if the screen reader was active, language in use) and information about the app functionalities used, including screens visited and exercises performed by the user. For the exercises, we collected information about the exercise family and type, and whether the user performed the exercise correctly and after how many attempts. In totalWordMelodies has been used by 408 unique users. Most (280, 69%) started using the app within the irst two months from the publication, while the app was actively publicised. Of these, 79 (28%) stopped using the app shortly afterwards, which is in agreement with normal app abandonment behavior 40]. Instead, [ the majority (211, 72%) continued accessing the app in the following months. During the data colle , 489 ction, log 29 records were registered. Half of these,(822) 14 were collected within the irst two months from the publication of the app. 5.1 App Usage by Device Type and Model With 276 (68%) users in total, iOS devices were more commonly used. This was expected because iOS devices are generally more popular among people with VIB 48].[However, Android was in use on 32% of the devices (132). This is more than we expected based on prior literature, which suggest that iOS users with VIB are about 80% of the total [25]. The majority of the users accesseW d ordMelodies from a smartphone (223, 55%), while 185 (45%) used tablets. However, tablet usage was higher than expected considering that smartphones are much more common than tablets (about 10 to 1 proportion)59[]. In particular, iOS users favored tablets, with 162 (59%) using iPads, and 111 (41%) using iPhones. Instead, only 20 (15%) Android users accesse WorddMelodies from a tablet, while 112 (85%) used a smartphone. Another interesting inding is that many of the iOS devices were quite dated: 32 (29%) iPhone users and 89 (55%) iPad users had a device older than 2017. 5.2 User Characteristics 366 (90%) users accessed WordMelodies in English and 42 (10%) in Italian. This was expected as the app was publicised more actively on English websites 21] and [social networks. Of the 42 Italian-speaking users, 30 (71%) also tried English exercises. This result highlights the need to also exercise foreign language literacy, which is reported as a challenge for children with VIB [20]. During the data collection, the app was publicised with associations, teachers and web communities of people with VIB. While we cannot be certain, we therefore expect that most users were people with VIB. Of those who used the app, 329 (81%) users never used the screen reader, 37 (9%) used it sometimes and 42 (10%) users always had it active. This conirms prior indings that only a small portion of mobile users with VIB actually use the screen reader [30]. Only 6 (8%) screen reader users were on Android, and 2 of them used the screen reader only sporadically. This conirms that blind users (more in general screen reader users) prefer iOS over Android [48]. 5.3 Functionalities Used Among the collected log records, the majority marked exercise starts , 254, (10 35%). However, only one third of the exercises (,3144) were completed. The others were started but never inished. We expected this behavior to be indicative of new users, who would try out the app rather than diligently doing exercises. However, further analyses revealed that this behavior was consistent for both new and regular users. One possible way to explain this behavior is that the users "browse" diferent exercises, starting them and exiting immediately, until they ind the ones they are interested in. ACM Trans. Access. Comput. WordMelodies • 13 Attempted multiple times Completed at first try Complete the Listen and Drag the word Drag the word Select the Write the letter sight words complete the to complete into the rhyming word of the alphabet sentence the sentence correct basket in the box Fig. 5. Frequently completed exercises, at first try and repeated at least once (English) 7797 (26%) log records were associated to menu navigation, such as exercise or topic selection, while there were 545 (2%) accesses to tutorial exercises, of which 42 (8%) referred to the drag&drop functionality. Tutorials were activated by 188 (46%) diferent users, while the language selection functionality was accessed 365 (1%) times by 137 (34%) diferent users. However, only 30 users actually performed exercises in both languages. These were all users who irst performed some exercises in Italian, and then tried some exercises in English. 5.4 Exercises Of the 3144 exercises completed by the users, 2678 (85%) were in English and 466 (15%) in Italian. 40 of the 46 (87%) available English exercises were completed at least once. As shown in Figure 5, the most popular exercise was łWrite the letter of the alphabet in the boxž, solved 647 times (24%). This was also the irst exercise on the exercise list inside the app. Others were much less used: łSelect the rhyming wordž was completed 224 times (8%), łDrag the word into the correct basketž 215 (8%) times, łDrag the word to complete the sentencež 214 (8%) times, and łListen and complete the sentencež 147 (7%) times. It is worth noting that ł’Complete the sight wordsž, an English language-speciic exercise was the 6th most popular exercise, with 104 (4%) completions. The great variety of performed exercises, and the fact that the most popular exercise was the irst one on the list was probably due to new users exploring the app. For the Italian users, 24 out of 36 (67%) available exercises were completed at least once. Figure 6 shows the number of completions for the six most popular exercises. The most frequently completed exercise was łDrag the correct ending letterž, with 96 (20%) runs, followed by łDrag the word into the correct basketž, completed 76 (16%) times. łWrite the letter of the alphabet in the boxž, the irst exercise on the list, had a much lower count of 39 (8%) runs. łDrag the correct indeterminate articlež was completed 35 (7%) times, łIdentify the correct statementž 28 (6%) times, and łChoose the related words from the tablež 25 (5%) times. 2467 (78%) of the completed exercises were correct at irst try. Similar results were obtained for both English 2088 (78%) and Italian 379 (81%). Instead, 554 (22%) exercises were answered incorrectly and thus had to be repeated at least once, 485 (22%) for English and 69 (19%) for Italian. Most commonly, the repeated exercises were also the most popular ones. However, repetitions over total attempts varied across diferent exercises, and between the two languages. We note that the exercises belonging to table the family, which were the most diicult ones during the user study, also had a higher number of repetitions than the average: 33% in English and 25% in Italian. ACM Trans. Access. Comput. 14 • Among the most popular exercises in English, łSelect the rhyming wordž was the most frequently repeated one (61 times, 27%). łDrag the word to complete the sentencež was also repeated more than average (23%, 49). Other exercises were less frequent, with łWrite the letter of the alphabet in the boxž and łComplete the sight wordsž repeated 19% (125) and 18% (19) of the time, respectively. In Italian, łDrag the correct ending letterž was the exercise with most repetitions among the six most popular ones (26, 27%). All other popular exercises had less than average amount of repetitions. łChoose the related words from the tablež had 4 (16%), łWrite the letter of the alphabet in the boxž had 6 (15%), łDrag the word into the correct basketž had 11 (14%), and łIdentify the correct sentencež had 3 (11%). łDrag the correct indeterminate articlež was repeated in only 1 occasion out of 35 (2%). The analysis of the exercises that are frequently repeated could be indicative of which literacy skills require more training for the students in general. More speciically, educators, parents, and teachers can beneit from knowing which speciic exercises are more diicult for the children. 6 DISCUSSION AND LIMITATIONS 6.1 Drag&Drop Usability Drag&drop is known to be a problematic touchscreen interaction for people with VIB. This emerges in the scientiic literatur 34]eand [ was also reported by two of the domain experts during analysis. Instead, our results suggest that the drag&drop gesture inWordMelodies is accessible to children with VIB and does not impact the system usability. Indeed, most children completed the exercises with the drag&drop interaction without needing any support from the educator. We believe that such a positive result is due to the characteristics of our design of the interface elements and the interaction, which was reined through several iterations conducted with people with VIB. In our design, the elements are made to be as big as possible, with large text, distinctive colors and consistent behavior. This makes the draggable elements and drop areas easy to distinguish for people with low vision, and text content easy to read. For blind users, the interaction is coupled with explicative messages that clearly explain what the user is doing or can do with each interface element. Furthermor WordMelo e, dies implements a tutorial that provides step-by-step instructions on how to use the drag&drop gesture, which can be activated in each exercise that uses this interaction. Remote usage data analysis conirms that the tutorial functionality is indeed frequently used by app users and therefore could be a contributing factor to the accessibility of Drag&Drop exercises. Attempted multiple times Completed at first try Choose the Identify Drag the correct Write the letter Drag the word Drag the related words the correct indeterminate of the alphabet into the correct ending from the table sentence article in the box correct basket letter Fig. 6. Frequently completed exercises, at first try and repeated at least once (Italian) ACM Trans. Access. Comput. WordMelodies • 15 6.2 Dificulties in Performing Table Exercises Autonomously Study results show that the exercises in the table family were the hardest, with only four participants who completed them autonomously. Remote data conirmed this inding, indicating a higher than average number of repetitions for table exercises. This is interesting because this family of exercises requires a simple form of interaction i.e(., only element selection). So, one question emerges: what limits children autonomy in completing exercises in this family? Answering this question would require a new set of experiments but we can make the following hypothesis: the problems with these exercises emerged due to the large number of elements shown on the screen. Indeed, exercises in the table family are the only ones showing up to 16 interaction elements (the table cells). This can negatively impact the user experience of all users; for those with low vision, a larger number of elements means that each element is smaller, while for screen-reader users there is an additional diiculty in navigating among many items. We believe that providing additional messages during screen reader navigation to highlight the current position in the table, the selection status of the traversed elements and to list the currently selected elements would help screen reader users. Instead, for users with low vision, we could improve the size of the table with respect to the screen area, the color contrast of the table cells and the text, or provide zoom on the currently traversed element. Additional iterations to improve the design of the tutorial tablefor exer the cises could also help, as previously experienced for the Drag&Drop exercises. 6.3 Finding the Desired Exercise The analysis of the logs uncovers that users tend to start many exercises without completing them. We suspect that this is due to the fact that it is not immediate to ind one given exercise, hence users tend to start many, before inding the intended one. Currently the app presents a list of etopics .g., łLearn ( to writež) each containing a list of exercise types, some of which have multiple diiculty levels. One problem is that the list of topics is long (12 items in English) and many exercises could be suitable for more than one topic. Thus, it could be diicult for the user to ind the correct one. For example, the łlearn to writeł topic contains two exercise types but indeed most of the other exercise types are designed to support the user to łlearn to writež like those in the łalphabetž topic. So, one additional design requirement that we will address in future is that users should easily ind the exercise they intend to practice with. A number of solutions can be adopted to improve the system along this direction. It is possible to re-organize the exercises into more meaningful topics, and provide a preview image and a meaningful description of each exercise. It is also possible to implement a functionality to search for exercises by name or ilter them based on the child age or grade. Finally, it would be possible to deine preferred exercises or allow a caregiver to prepare a list of exercises (possibly of diferent types) that the child has to complete. 6.4 Edutainment App Localization In our previous work2[], we higlighted that exercises should be speciically designed to address linguistic skills required for each language. This is supported by the remote logging data analysis. Indeed, we note how popular exercises in English and Italian are diferent. Most importantly, we notice that language-speciic exercises, for example exercises on sight-words in English, are among the most popular ones. Furthermore, we also highlight that the majority of the Italian users of the app also accessed exercises in English. This is consistent with prior works that identify foreign language learning as a challenge for children with VIB20 [ ]. Based on this inding, we think W that ordMelodies could be an efective instrument for improving foreign language literacy. ACM Trans. Access. Comput. 16 • 7 CONCLUSIONS AND FUTURE WORK This paper presents the evaluation of W the ordMelodies mobile application 2] thr[ough a user study with 11 children, and the analysis of remotely collected usage logs. Results show that the app is usable, with a SUS score of 79, which is higher than other educational mobile apps and considered excellent based on prior benchmarks. The participants were autonomous in performing most of the exercises, even those based on the drag&drop interaction, which has so far been considered challenging for users with VIB. We achieved this result by carefully designing the interface elements and the screen reader messages provided while performing this interaction. Our design could be adapted to be used in other mobile applications, thus improving the accessibility of the Drag&Drop interaction in other mobile apps. We also uncover two key limitations of the current app. First, table theexercise family is found to be more diicult than the others, and often users need support to complete these exercises. Our intuition is that the users ind it diicult to visualize and navigate table exercises due to the presence of too many interactive elements. We discuss a number of possible design principles that could improve the accessibility of table exercises, but more generalizable indings, related to the accessibility of table content on touchscreens, could be drawn from a thorough future investigation. Another possible improvement is to provide more detailed instructions for the interaction with tables, similar to what we have done for the drag&drop exercises. We will also investigate alternative table exercises that are easier to answer than word association exercises. The second limitation is related to exercise selection; with the growing number of the exercises available inWordMelodies, the current list-based selection is not efective. We propose a number of solutions, aimed to simplify the search for a desired exercise, which we will explore as future work. Another major challenge that we wish to explore as a future work is the evaluation of the educational eicacy WordMelo of dies. We are planning to achieve this through a longitudinal study that involves multiple children, with and without VIB, and educators. Furthermore, other functionalities and personalization capabilities are also being investigated. As future work, we will expand the creation of exercises in other languages and we will investigate the use of the system for foreign language teaching. We are also working on a web-based dashboard for exercise creation and monitoring of the responses to support teachers during the use of the platform in classroom. Finally, we will include the support for the personalization of the app, including changing colors and verbal interaction messages. ACKNOWLEDGMENTS We wish to thank I.Ri.Fo.R. Pisa, and in particular Michele Materazzi for the invaluable support provided during the experiments. We also thank Diane Brauner for her precious insight during the conceptualization of the system. REFERENCES [1] Dragan Ahmetovic, Valeria Alampi, Cristian Bernareggi, Andrea Gerino, and Sergio Mascetti. 2017. Math Melodies: Supporting Visually Impaired Primary School Students in Learning Math. Proce Inedings of the 14th Web for All Conference on The Future of Accessible Work . ACM, 26. [2] Dragan Ahmetovic, Cristian Bernareggi, Irene Mantegazza, and Sergio Mascetti. 2021. WordMelodies: an Inclusive Mobile App Supporting the Acquisition of Literacy Skills. International In Web for All Conference . ACM. [3] Dragan Ahmetovic, Cristian Bernareggi, Sergio Mascetti, and Federico Pini. 2020. SoundLines: Exploration of Line Segments through Soniication and Multi-touch Interaction. ACMInSIGACCESS Conference on Computers and Accessibility (ASSETS). [4] APH. [n. d.]. Braille Buzz. https://www.aph.org/product/braille-buzz/. Accessed: 2022-01-29. [5] Dorit Aram and Orit Chorowicz Bar-Am. 2016. Mothers helping their preschool children to spell words: A comparison between interactions using the computer vs. pencil and pap International er. Journal of Child-Computer Interaction7 (2016), 15ś21. [6] Abraham Arcavi. 2003. The role of visual representations in the learning of mathematics. Educational studies in mathematics 52, 3 (2003), 215ś241. ACM Trans. Access. Comput. WordMelodies • 17 [7] Aaron Bangor, Philip T Kortum, and James T Miller. 2008. An empirical evaluation of the system usability Intl. Journal scale of. HumanśComputer Interaction 24, 6 (2008), 574ś594. [8] Florence Bara, Edouard Gentaz, and Dannyelle Valente. 2018. The efect of tactile illustrations on comprehension of storybooks by three children with visual impairments: An exploratorJournal y study.of Visual Impairment & Blindness112, 6 (2018), 759ś765. [9] Cristian Bernareggi, Dragan Ahmetovic, and Sergio Mascetti. 2019. MuGraph: Haptic Exploration and Editing of 3D Chemical Diagrams. In Conference on Computers & Accessibility. ACM. [10] Beth Beschorner and Amy C Hutchison. 2013. iPads as a literacy teaching tool in early childho International od. Journal of Education in Mathematics, Science and Technology 1, 1 (2013), 16. [11] Virginia Bower. 2011. Creative Ways to Teach Literacy: Ideas for Children Aged 3 to 11. Sage. [12] Deborah Chen and Jamie Dote-Kwan. 2018. Promoting emergent literacy skills in toddlers with visual impairments. Journal of Visual Impairment & Blindness 112, 5 (2018), 542ś550. [13] Common Core State Standards Initiative. 2010. Common core state standards for English language arts & literacy in history/social studies, science, and technical subjects, Appendix A. [14] CJ Craig. 1996. Family Support of the Emergent Literacy of Children with Visual Impairments. Journal of Visual Impairment & Blindness 90, 3 (1996), 194ś200. [15] Nicol Dalla Longa and Ornella Mich. 2013. Do animations in enhanced ebooks for children favour the reading comprehension process? A pilot study. In Proceedings of the 12th international conference on interaction design and children . 621ś624. [16] Frances Mary D’Andrea and Carol Farrenkopf. 2000.Looking to learn: Promoting literacy for students with low vision. American Foundation for the Blind. [17] Pauline Davis and Vicky Hopwood. 2002. Including children with a visual impairment in the mainstream primary school classroom. Journal of Research in Special Educational Needs2, 3 (2002), nośno. [18] Amy G Dell, Deborah A Newton, and Jerry G Petrof. 2012.Assistive technology in the classroom: Enhancing the school experiences of students with disabilities. Pearson Boston, MA. [19] Thomas Dick and Evelyn Kubiak. 1997. Issues and aids for teaching mathematics to theThe blind. Mathematics Teacher (1997). [20] Athanasia Efstathiou and Stavroula Polichronopoulou. 2015. Teaching English as a foreign language to visually impaired students: Teaching materials used by teachers of English. Enabling Access for Persons with Visual Impairment67 (2015). [21] Perkins eLearning. [n. d.]. Blog on WordMelodies. https://www.perkinselearning.org/technology/blog/word-melodies-emerging- reading-and-writing-app. Accessed: 2022-01-29. [22] Karen A Erickson and Deborah Hatton. 2007. Literacy and visual impairment. Seminars In in speech and language, Vol. 28. Copyright© 2007 by Thieme Medical Publishers, Inc., 333 Seventh Avenue, New ..., 058ś068. [23] William W Gaver. 1986. Auditory icons: Using sound in computer interfaces. Human-computer interaction 2, 2 (1986), 167ś177. [24] Andrea Gerino, Nicolo Alabastro, Cristian Bernareggi, Dragan Ahmetovic, and Sergio Mascetti. 2014. Mathmelodies: inclusive design of a didactic game to practice mathematics. International In Conference on Computers Helping People With Special Needs. Springer. [25] Nora Griin-Shirley, Devender R Banda, Paul M Ajuwon, Jongpil Cheon, Jaehoon Lee, Hye Ran Park, and Sanpalei N Lyngdoh. 2017. A survey on the use of mobile applications for people who are visually impair Journal of ed.Visual Impairment & Blindness111, 4 (2017), 307ś323. [26] Shayl F Griith, Mary B Hagan, Perrine Heymann, Brynna H Helin, and Daniel M Bagner. 2020. Apps as learning tools: a systematic review.Pediatrics 145, 1 (2020). [27] Kenneth A Hanninen and Aaster Raynor. 1975.Teaching the visually handicapped. Merrill. [28] Andrea Hathazi and Mihaela Bujor. 2013. Development of tactile strategies and use of tactile resources in emergent literacy at children with visual impairment. Psychologia paedagogia (2013), 41. [29] Italian Ministry of Education. 2004. Indicazioni Nazionali per i Piani di Studio Personalizzati nella Scuola Primaria. [30] Hernisa Kacorri, Sergio Mascetti, Andrea Gerino, Dragan Ahmetovic, Valeria Alampi, Hironobu Takagi, and Chieko Asakawa. 2018. Insights on Assistive Orientation and Mobility of People with Visual Impairment Based on Large-Scale Longitudinal Transactions Data. on Accessible Computing (2018). [31] Jeeeun Kim, Abigale Stangl, and Tom Yeh. 2014. Using LEGO to model 3D tactile picture books by sighted children for blind children. In Proceedings of the 2nd ACM symposium on Spatial user interaction. 146ś146. [32] Abhishek Kumar, K Vengatesan, M Rajesh, and Achintya Singhal. 2019. Teaching literacy through animation & multime International dia. Journal of Innovative Technology and Exploring Engineering8, 5 (2019), 73ś76. [33] Steven Landau and Karen Gourgey. 2001. Development of a talking tactile tablet. Information Technology and Disabilities7, 2 (2001). [34] Barbara Leporini and Eleonora Palmucci. 2017. A mobile educational game accessible to all, including screen reading users on a touch-screen device. InProceedings of the 16th World Conference on Mobile and Contextual Learning . 1ś4. [35] James R Lewis. 1993. Multipoint scales: Mean and median diferences and observed signiicance International levels. Journal of Human-Computer Interaction 5, 4 (1993), 383ś392. ACM Trans. Access. Comput. 18 • [36] James R Lewis. 2018. The system usability scale: past, present, and futur International e. Journal of HumanśComputer Interaction 34, 7 (2018), 577ś590. [37] James R Lewis and Jef Sauro. 2018. Item benchmarks for the system usability scale Journal . of Usability Studies13, 3 (2018). [38] Sandra Lewis. 2020. Education for students with visual impairments in the time of coronavirus: An approach to education through videoconferencing. , 171ś172 pages. [39] Sandra Lewis and Joan Tolla. 2003. Creating and using tactile experience books for young children with visualTimpairments. eaching Exceptional Children 35, 3 (2003), 22ś29. [40] Localytics. [n. d.]. 25% of Users Abandon Apps After One Use. https://uplandsoftware.com/localytics/resources/blog/25-of-users- abandon-apps-after-one-use/. Accessed: 2022-01-29. [41] Pedro Lopes, Alexandra Ion, Willi Mueller, Daniel Hofmann, Patrik Jonell, and Patrick Baudisch. 2015. Proprioceptive interaction. In Proceedings of the 33rd annual acm conference on human factors in computing systems . 939ś948. [42] Sergio Mascetti, Andrea Gerino, Cristian Bernareggi, and Lorenzo Picinali. 2017. On the evaluation of novel soniication techniques for non-visual shape exploration. ACM Transactions on Accessible Computing (TACCESS) 9, 4 (2017), 1ś28. [43] Sergio Mascetti, Giovanni Leontini, Cristian Bernareggi, and Dragan Ahmetovic. 2019. WordMelodies: supporting children with visual impairment in learning literacy ACM. In SIGACCESS Conference on Computers and Accessibility. ACM. [44] Carolane Mascle, Christophe Joufrais, Gwenaël Kaminski, and Florence Bara. 2022. Displaying easily recognizable tactile pictures: A comparison of three illustration techniques with blind and sighteJournal d childr ofen. Applied Developmental Psychology78 (2022), [45] Maureen McLaughlin and Brenda J Overturf. 2012. The common core: Insights into the Kś5 standarThe ds. Reading Teacher 66, 2 (2012), 153ś164. [46] Joshua A Miele, Steven Landau, and Deborah Gilden. 2006. Talking TMAP: Automated generation of audio-tactile maps using Smith- Kettlewell’s TMAP softwarBritish e. Journal of Visual Impairment24, 2 (2006), 93ś100. [47] Kathleen M Minke, George G Bear, Sandra A Deemer, and Shaunna M Griin. 1996. Teachers’ experiences with inclusive classrooms: Implications for special education rThe eform. Journal of Special Education30, 2 (1996), 152ś186. [48] John Morris and James Mueller. 2014. Blind and deaf consumer preferences for android and iOS smartphones. InclusivIn e designing. Springer, 69ś79. [49] Tauik Muhtarom et al . 2019. The urgency of Interactive Animated Learning Media Development for Facilitating Literate Skills for The Student of Primary School. Journal In of Physics: Conference Series , Vol. 1254. IOPublishing, 012034. [50] Michelle M Neumann and David L Neumann. 2017. The use of touch-screen tablets at home and pre-school to foster emergent literacy. Journal of Early Childhood Literacy17, 2 (2017), 203ś220. [51] Denis Nikitenko and Daniel Gillis. 2014. Touching the data: Exploring data soniication on mobile touchscr Procedia een devices. Computer Science 34 (2014), 360ś367. [52] ObjectiveED. [n. d.]. Braille Sheets. https://www.objectiveed.com/braille-sheets. Accessed: 2022-01-29. [53] Cynthia Putnam, Melisa Puthenmadom, Marjorie Ann Cuerdo, Wanshu Wang, and Nathaniel Paul. 2020. Adaptation of the system usability scale for user testing with childr Extende en. In d Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems . 1ś7. [54] Anne Spencer Ross, Xiaoyi Zhang, James Fogarty, and Jacob O Wobbrock. 2017. Epidemiology as a framework for large-scale mobile application accessibility assessment. ProceeIn dings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility . 2ś11. [55] Martin Schmitz, Mohammadreza Khalilbeigi, Matthias Balwierz, Roman Lissermann, Max Mühlhäuser, and Jürgen Steimle. 2015. Capricate: A fabrication pipeline to design and 3D print capacitive touch sensors for interactiv Proceeedings objects. ofIn the 28th Annual ACM Symposium on User Interface Software & Technology . 253ś258. [56] Lei Shi, Holly Lawson, Zhuohao Zhang, and Shiri Azenkot. 2019. Designing interactive 3D printed models with teachers of the visually impaired. Pr Inoceedings of the 2019 CHI Conference on Human Factors in Computing Systems . 1ś14. [57] Kristen Shinohara and Jacob O Wobbrock. 2011. In the shadow of misperception: assistive technology use and social interactions. In Conference on Human Factors in Computing Systems. ACM. [58] Abigale Stangl, Jeeeun Kim, and Tom Yeh. 2014. Technology to support emergent literacy skills in young children with visual impairments. In Proceedings of the extended abstracts of the 32nd annual ACM conference on Human factors in computing systems . ACM, 1249ś1254. [59] Statcounter. [n. d.]. Desktop vs Mobile vs Tablet Market Share Worldwide. https://gs.statcounter.com/platform-market-share/desktop- mobile-table. Accessed: 2022-01-29. [60] Edward Steinfeld and Jordana Maisel. 2012. Universal design: Creating inclusive environments. John Wiley & Sons. [61] Josephine M Stratton and Suzette Wright. 1991. On the Way to Literacy: Early Experiences for Young Visually ImpairedRE: Children. view 23, 2 (1991), 55ś62. [62] Sensory Sun. [n. d.]. Exploring Braille with Madilyn and Ruf. https://www.sensorysun.org/apps/. Accessed: 2022-01-29. [63] Ann P Turnbull et al. 1995.Exceptional lives: Special education in today’s schools. ERIC. ACM Trans. Access. Comput. WordMelodies • 19 [64] Prokopia Vlachogianni and Nikolaos Tselios. 2021. Perceived usability evaluation of educational technology using the System Usability Scale (SUS): A systematic revieJournal w. of Research on Technology in Education(2021), 1ś18. [65] David Wray, Richard Fox, Jane Medwell, and Louise Poulson. T2002. eaching literacy efectively in the primary school. Psychology Press. [66] Dominic Wyse, Russell Jones, Helen Bradford, and Mary Anne Wolpert. T2018. eaching English, language and literacy. Routledge. [67] Wai Yu, Ramesh Ramloll, and Stephen Brewster. 2000. Haptic graphs for blind computer users. International In Workshop on Haptic Human-Computer Interaction. Springer. ACM Trans. Access. Comput.

Journal

ACM Transactions on Accessible Computing (TACCESS)Association for Computing Machinery

Published: Mar 29, 2023

Keywords: Visual impairment

There are no references for this article.