For Della Calder, none of the Augmentative and Alternative Communication (AAC) apps she tried seemed to resonate. SheŌĆÖd been in speech therapy for a few years and had used a few different apps and devices, but nothing stuckŌĆönot to mention that each came with a hefty price tag. ThatŌĆÖs why her brother, Archer, decided to build an open source app that could be tailored to DellaŌĆÖs needs and preferences.┬?
With help from the open source community, Archer created FreeSpeech, an app that allows users to communicate by pushing individual buttons for words and ideas, which the app then translates to speech. When Archer first showed Della the app, he put words for all of her favorite thingsŌĆösnacks, TV shows, and school buses among themŌĆöinstead of the usual collection of words found in proprietary AAC apps.┬?
It was an immediate hit, and ever since, Della has been increasingly able to communicate with and participate in the world around her.┬?┬?
ŌĆ£Communication shouldnŌĆÖt be restricted just to people who can talk,ŌĆØ says Archer. ŌĆ£People who are nonverbal have the same right to communication, and they shouldnŌĆÖt have to pay for it.ŌĆØ
Check out the video belowŌĆöthe latest in GitHubŌĆÖs Coding Accessibility video seriesŌĆöto learn how the open source accessibility software Archer created, with Della at his side, has enabled her to participate in the world where proprietary alternatives failed.
A copy of this video with audio descriptions of visual content is also available on YouTube.
DellaŌĆÖs ability to be a part of FreeSpeechŌĆÖs development process has been key to its success. ŌĆ£Watching Della use software, then attempting to emulate those usage patterns in FreeSpeech, has been really beneficial to her experience using the application,ŌĆØ Archer says. For example, he says that watching her navigate YouTube by clicking through suggested videos until she found what she was looking for, rather than using navigation elements like search or categories, inspired FreeSpeechŌĆÖs initial design.
ŌĆ£ItŌĆÖs this mode of collaboration, where she's on a canary branch trying new features as I refine what she uses and what she doesn't, that I think makes FreeSpeech so intuitively useful for so many people,ŌĆØ Archer says.
This mode of collaboration is also known as participatory design, or co-design as itŌĆÖs commonly called these days, which emphasizes the importance of actively including all stakeholders in the design process to ensure the end product meets their needs.┬?
Having watched Della use other apps, Archer decided to allow users to disable the ŌĆśsentence builderŌĆÖ featureŌĆösomething that comes standard in other AAC apps. With the sentence builder disabled, the app acts as more of a sound board, allowing users to communicate with single words rather than forcing grammatically complete sentences. He points to this decision as one example of this co-design process, where Della contributed to a more accessible and useable product for herself and others by participating in its design.
ŌĆ£That communication style can sometimes be 10x more effective for Della,ŌĆØ Archer says. ŌĆ£IŌĆÖve seen a lot of people get hung up and frustrated when theyŌĆÖre made to use full sentences and nothing less. The problem is caused by the AAC software's inability to meet users where they're at, communication-wise.ŌĆØ
Archer also points to another FreeSpeech featureŌĆöthe ability to add new vocabulary remotely via the cloud, rather than just on her deviceŌĆöas one that meets DellaŌĆÖs individual needs, since taking away her hardware to make changes means taking away her voice. ŌĆ£She doesnŌĆÖt want me to take her iPad,ŌĆØ he says. ŌĆ£ThatŌĆÖs her connection to the world.ŌĆØ
Since FreeSpeech makes it quick and easy to add new buttons, Della has expanded her vocabulary to include a wider range of topics she cares about. Previously, her family might need to scroll through endless options when searching for a movie to watch until they happen to land on the right one. Now, Della has had all her favorites added, so she can request them directly instead.┬?
Beyond logistics like picking a movie or a snack, she has also added the people in her life, such as classmates and teachers, so that she can talk about what happened at school that day. One day, while they were watching a TV show, she asked Archer to add a new button using a screenshot of a particularly sad moment in the episode. Now, Della uses that button in combination with others, such as people at her school, to better express herself.┬?
ŌĆ£She would use that button to talk about if she was sad, or if something sad happened at school,ŌĆØ says Archer. ŌĆ£That linking of ideas was something that she was never able to do before with other AAC apps. I think sheŌĆÖs really into FreeSpeech because itŌĆÖs tailored to her.ŌĆØ
