Supporting Autonomous Navigation of Visually Impaired People for Experiencing Cultural Heritage

Abstract

In this chapter, we present a system for indoor and outdoor localization and navigation to allow the low vision users in experiencing cultural heritage in autonomy. The system is based on the joint utilization of dead-reckoning and computer vision techniques on a smartphone-centric tracking system. The system is explicitly designed for visually impaired people, but it can be easily generalized to other users, and it is built under the assumption that special reference signals, such as colored tapes, painted lines, or tactile paving, are deployed in the environment for guiding visually impaired users along pre-defined paths. Differently from previous works on localization, which are focused only on the utilization of inertial sensors integrated into the smartphones, we exploit the smartphone camera as an additional sensor that, on one side, can help the visually impaired user to identify the paths and, on the other side, can provide direction estimates to the tracking system. The users with the help of the navigation system may experience the museum or the cultural site in autonomy, by following a path previously decided and by going from a location of interest to another, without any external personal assistant. We demonstrate the effectiveness of our approach, by means of experimental tests performed in a controlled indoor environment and in a real outdoor installation.