Seeing with the Hands: A sensory substitution that supports manual interactions
Автор: HCintegration
Загружено: 2025-04-22
Просмотров: 261
Our team at the University of Chicago engineered a wearable device that enables users to see with their hands when hovering over objects. This is a sensory substitution device that assists with perceiving objects by translating one modality (e.g., vision) into another (e.g., tactile), developed to the need of Blind and Low Vision users. The user can feel tactile images rendered on their hands using an electrotactile display from a miniature camera mounted on the palmar side of their hands. This new perspective of seeing allows users to leverage the hands’ affordance—hand faces towards objects to grasp allows hand preshaping, and flexibility—hands move rapidly, reaching from multiple angles, exploring tight spaces, circling occluded objects, etc. This opens a new possibility to support manual tasks in everyday life without vision.
Project website: https://seeingwiththehands.com/
Shan-Yuan Teng*, Gene S-H Kim*, Xuanyou Liu*, and Pedro Lopes (*equal contribution). 2025. Seeing with the Hands: A Sensory Substitution That Supports Manual Interactions. In CHI Conference on Human Factors in Computing Systems (CHI ’25), April 26–May 01, 2025, Yokohama, Japan. ACM, New York, NY, USA, 14 pages. https://doi.org/10.1145/3706598.3713419
Доступные форматы для скачивания:
Скачать видео mp4
-
Информация по загрузке:
