EyeHarp, a digital musical instrument through sight

EyeHarp, a digital musical instrument through sight

Pompeu Fabra University

Digital musical instrument for people with physical disabilities which, thanks to eye-tracking and interaction and expressiveness with the instrument, allows to select chords, arpeggios, melody and volume, allowing to produce notes and create melodies with the gaze.

The programme works with an eye-tracker, a special camera that monitors eye movement, and with a software that must be installed on the device. The software download is open source and free of charge, and allows you to learn music from scratch and improve your technique. In addition, it adapts to the level of musical knowledge of each user, and includes a variety of sounds and melodies.

EyeHarp has been specially designed for people diagnosed with cerebral palsy, amyotrophic lateral sclerosis, muscular dystrophy, upper limb amputation or spinal cord injury. It is also suitable for people with intellectual disabilities. In addition, the Eye Harp Association offers training for music therapists and music teachers, as well as music lessons for people with motor disabilities.

The programme aims to improve the quality of life of users, as playing music with EyeHarp provides health benefits: musical training stimulates certain parts of the brain and improves verbal and auditory memory, among others. It also promotes self-esteem, emotional expression and creativity.

EyeHarp has made it possible to create digital and accessible musical instruments by combining computer science and music. In short, it offers an innovative and revolutionary service for music education and music therapy.

La Mesita, a virtual desk for the reading development of children with disabilities

La Mesita, a virtual desk for the reading development of children with disabilities

CEDETi UC

Free application that, through play and exploration, facilitates the process of learning to read and write in children with disabilities through technologies based on inclusive education.


The way in which the exploration is proposed, autonomous and without order, is a way of learning that helps in the construction of learning to read, facilitates an enrichment of vocabulary and familiarization with elements of reading awareness.


The virtual desk is designed with different activity paths, which are chosen and adapted to the needs of each child. At first, an understanding of the initial level of the different dimensions to be worked on is made, in order to select the most appropriate games and design a personalized program that helps and encourages reading. The activities can be modified according to the child’s evolution.


It is a flexible virtual tool with four dimensions. First, the development of oral comprehension is done through the viewing of videos, reading texts, and activities such as sorting stories as they are narrated. Phonological awareness is worked on through the fragmentation and creation of words, with the support of drawings, the identification of sounds and phonics activities with the microphone. At the semantic level, words of the same categories are grouped and questions are asked about the reason for these differentiations. Finally, vocabulary acquisition is done through description games with adjectives to learn their meaning and their use in other contexts.


Espai Obert, an alternative service to institutionalization for people with severe psychosocial disabilities.

Espai Obert, an alternative service to institutionalization for people with severe psychosocial disabilities.

Fundació Support-Girona Foundation and Healthcare Assistance Institute (IAS)

Alternative resource to institutionalization for people with severe psychosocial disabilities, which offers them social and health support based on the pact and their free will to use the services of the facility.

It is aimed at people who are in a situation of social exclusion and even homelessness, due to mental and behavioral disorders or substance abuse problems, and who have no family or social support or financial resources,

Espai Obert aims to reduce the stigma of these people and overcome the barriers that stand in the way of their social and community inclusion. The intervention methodology is based on low demand and free use.

As a first phase of intervention, the aim is to cover the basic needs of hygiene and food. Therefore, the service is equipped with a kitchen, living and dining room, washing machines, patio and shower and hygiene areas, and the users participate in the routines of the center (preparing meals, laundry, taking care of the garden…). Once this first phase has been achieved, a bond of trust is built, in order to work on the development, skills and well-being of each person, as well as socialization with other people in the space and other resources in the area.

This pioneering intervention model is one of the tools to be deployed in Catalonia in the process of reconversion and transformation of long-stay psychiatric hospitalization with functional recovery and life project units based on the successful experience of the counties of Girona, where in 2004 the long-stay psychiatric hospital in the former Salt Psychiatric Hospital was closed, generating a network of community mental health and addiction services, with alternative resources.


Park4Dis, making it easier for people with reduced mobility to find a parking space

Park4Dis, making it easier for people with reduced mobility to find a parking space

Park4Dis

Digital platform for the management and access to parking spaces reserved for people with reduced mobility.

It is a free webapp that offers users the location of parking spaces for people with reduced mobility. Once the space is located it directs to the place through GoogleMaps. It also informs about the specific rules of each municipality that apply to people with disabilities, and shows the restricted traffic zones of each municipality. The application also allows offline use by downloading maps.

Park4Dis has registered more than 39,000 parking spaces in Spain for people with reduced mobility, located in 230 different municipalities. To obtain information on existing spaces, it relies on the collaboration of local social entities and volunteers who help to map them. The service also works with public institutions, vIt is an approach aimed at changing the paradigm from smart cities to smart human cities.

Park4Dis was born from the difficulty that people with reduced mobility often have in finding the location of reserved parking spaces, in addition to the lack of knowledge of the regulations by many municipalities. That is why its transversality allows to gather all the information in a single App, promoting accessible and interurban mobility.

Artificial Intelligence to manage municipal home care better

Artificial Intelligence to manage municipal home care better

Helsingborg City Council

Artificial Intelligence tool that enables more preventive, proactive and efficient management of municipal home care services.

The algorithm uses the data history of each citizen and an assessment of their functional status by social services professionals according to the ICF index (International Classification of Functioning, Disability and Health). From patterns it identifies people at high risk of having extensive future needs, determines the potential for improvement with appropriate interventions, identifies which individuals and efforts are most likely to provide lasting improvement, and triggers concrete preventive measures to stop or delay the need for home care services.

At the same time, it is a support tool for municipal social professionals, as it helps them to better measure the efforts invested for each situation, to direct key resources where they can be most useful, to reduce time spent on unnecessary administrative tasks, or to reduce stress caused by the risk of making incorrect or too late decisions regarding the intervention or response needed by each person.

Virtea, virtual reality to reduce stress for people with ASD

Virtea, virtual reality to reduce stress for people with ASD

Virtea

Virtual reality application that allows the recreation of different scenarios that are part of a specific activity to approach the situations in which people with autism spectrum disorder (ASD) will find themselves.

Virtea is focused on preparing children with ASD for stressful situations through the recreation of scenarios, which are part of the training that children will have to face different events. Everyday situations such as visiting a doctor, getting a haircut or waiting for the bus can generate a lot of nerves and anxiety. For this reason, virtual reality makes the journey from the waiting room to the doctor’s office, or to the hairdresser’s chair: Virtea makes it possible to work under conditions that in the future will be natural in a completely controlled context.


The recreation has been supervised by specialists, working as realistically as possible, and every detail is recreated, including the sunlight from the window. The recreation tries to be as warm as possible through the lighting, both interior and exterior, to lower the stress levels of the user.


The benefits of this tool are threefold: anticipation, stress reduction and improved quality of life. Firstly, anticipation helps to improve the attitude towards new situations that are out of the usual routine. In these moments of fear or discomfort, Virtea helps to reduce stress and this improves the quality of life of people with ASD and their families. The previous work allows to control anxious situations.

Soy Cappaz, support for the autonomous life of people with intellectual disabilities

Soy Cappaz, support for the autonomous life of people with intellectual disabilities

Fundació Mapfre i Fundació GMP

Mobile application that promotes the autonomy of people with intellectual disabilities in their daily life and work environments. The tool increases the freedom and security of the person with a disability, and the peace of mind of their professional or family members, thanks to better coordination between the user and the support staff, who can follow the activity of the person with a disability with alerts and in real time.

Soy Cappaz has 4 main functionalities: calendar, where I am, my work and I need help. The first one, calendar, allows remembering important appointments and is synchronised with Google Calendar, so that it can be updated by a support person from any device. Secondly, the where I am function is useful for commuting and keeps support people informed of delays or detours. My Jobs has personalised videos on specific tasks (such as how to use the printer at work or how to put the washing machine on) and can be activated by scanning sticker barcodes. Finally, the I need help button allows you to communicate directly with support people in case of an emergency.

It is an easy-to-use tool adapted to the needs of the target group, including tutorials on how to use it. The aim is to reduce the employment gap suffered by people with intellectual disabilities through a practical and simple tool that facilitates their daily and working life.   

Seeing Al, an app that explains to blind people the world around them.

Seeing Al, an app that explains to blind people the world around them.

Microsoft

A free mobile application designed for people who are blind or visually impaired, based on Artificial Intelligence and Cognitive Services technologies, which facilitates the recognition of the environment and audio description of people, objects and texts.

Seeing Al has several channels, including the reading of short texts through the camera, document recognition, identification of products in packaging and access to information such as expiration date or processing through barcode scanning, as well as facial and environmental recognition.

Person recognition allows a refined description of space, where it not only describes in a simple way the elements of a room (such as a chair and three people), but is able to tell which people are involved (e.g. family or friends). In addition, it also identifies the people in the photographs.

The design is inclusive and the testing process has actively involved people with disabilities through non-profit organizations around the world. It is an example of the benefits of co-design.


Talking Mats, a visual communication tool for people with communication difficulties.

Talking Mats, a visual communication tool for people with communication difficulties.

Talking Mats

Talking pad that facilitates communication for people with communication difficulties (dementia, autism and brain injuries, among others). It is a versatile resource that allows to increase the communicative capacity in an effective and innovative way.

The tool works with three sets of communication symbols and images. First, there are thematic cards that define the topic of discussion, e.g., home life. Secondly, there are option cards within this, such as pets, or household cleaning. Finally, the Likert scale is provided, a rating scale that allows you to place yourself between three points: good, bad, and somewhere in between. Once the three sets of symbols have been presented, the participant can say how he/she feels about each card, placing it on the scale and with the possibility of moving them if there is a change of opinion. In addition, the tool is available in physical and digital format.

The project has an impact on various social sectors, especially education, social and health care and justice. At the educational level, children can express their feelings, visions and aspirations, i.e. have a voice with an impact. At the socio-health level, a framework for decision making and support in planning and self-management of needs is provided. It is important to take into account the wishes of each individual. In the field of justice, Talking Mates allows to open conversations on various topics, providing a structure that allows the expression of what is important and the comparison of various points of view.

It is a tool for thought and expression, with the aim of reducing the impact of communication difficulties for the people who use it. Talking Mates supports comprehension by allowing the processing of concepts through the breakdown of information, giving time to respond and reducing memory requirements. In addition, the quality of the information is improved by giving control to the respondent and providing a structured framework for open-ended questions.

Harvi, hearing habilitation in noise environments through virtual reality  

Harvi, hearing habilitation in noise environments through virtual reality  

Eunate (Associació de Famílies de Persones Sordes de Navarra)

A tool that improves the hearing of deaf people in noisy environments. It is a technological device that improves the daily life of these people and facilitates their auditory, linguistic, educational, occupational and socio-emotional development.

The initiative makes it possible to work on hearing in virtual environments with a 360° field of vision and surrounding sound. With this technological innovation, deaf people can enter everyday spaces such as a dining room, a shopping mall or a terrace, and hear the different background sounds in these places, facilitating their participation and interaction when they are in these environments.

The auditory discrimination tool is used with a speech therapist, who controls the volume of the different sounds to promote learning in the identification of “background noise”, and to develop strategies to improve listening and communication.

The project has been developed by EUNATE, an organization that works with deaf people and their families, with the aim of reducing the barriers to inclusion that this group has and promote a comprehensive and global improvement for them.