Current Projects
Non-visual touch screen interface running on a mobile phone

Improving touch screen accessibility for people with vision impairments

How can touch screen user interfaces be adapted for people with vision impairments? In this research, we explore how to design gesture-based user interfaces for users with vision impairments.

  • Oh, U., Kane, S.K., and Findlater, L. (2013). Follow that sound: using sonification and corrective verbal feedback to teach touchscreen gestures. Proceedings of ASSETS '13, ACM, 8 pages. [ACM] [PDF]
  • Kane, S.K., Morris, M.R., Perkins, A.Z., Wigdor, D., Ladner, R.E., and Wobbrock, J.O. (2011). Access Overlays: improving non-visual access to large touch screens for blind users. Proceedings of UIST '11, ACM, 273-282. [ACM] [PDF]
  • Kane, S.K., Wobbrock, J.O. and Ladner, R.E. (2011). Usable gestures for blind people: understanding preference and performance. Proceedings of CHI ’11,ACM, 413-422. Winner of Best Paper Award. [ACM] [PDF]
  • Kane, S.K., Bigham, J.P. and Wobbrock, J.O. (2008). Slide Rule: making mobile touch screens accessible to blind people using multi-touch interaction techniques. Proceedings of ASSETS '08, ACM, 73-80. [ACM] [PDF]
wearable camera

Designing mobile and wearable assistive technologies

Mobile and wearable devices are becoming increasingly common. This research explores accessibility issues surrounding wearable devices, and identifies opportunities for using wearable devices to improve accessibility.

  • Carrington, P., Hurst, A., and Kane, S.K. (2014). Wearables and chairables: inclusive design of mobile input and output devices for power wheelchair users. Proceedings of CHI ’14, ACM, to appear. [PDF]
  • Kane, S.K., Frey, B., and Wobbrock, J.O. (2013). Access Lens: a gesture-based screen reader for real-world documents. Proceedings of CHI ’13, ACM, 347-350. [ACM] [PDF] [Video]
Mobile phone in use

Studying how people with disabilities use current mobile technologies

Our research group has conducted several user studies that explore how people with disabilities use current mobile devices and assistive technologies, in order to identify new opportunities for accessible technology.

  • Said, K., Williams, M.A., Hurst, A., and Kane, S.K. (2014). Framing the conversation: the role of Facebook conversations in shopping for eyeglasses. Proceedings of CSCW ‘14, ACM, to appear. [PDF]
  • Kane, S.K., Jayant, C., Wobbrock, J.O. and Ladner, R.E. (2009). Freedom to roam: a study of mobile device adoption and accessibility for people with visual and motor disabilities. Proceedings ofASSETS '09, ACM, 115-122. [ACM] [PDF]
3d printed tactile map

3D printed tactile graphics

Rapid prototyping technologies such as 3D printers enable new capabilities for creating tactile graphics and physical interfaces for people with vision impairments.

  • Kane, S.K. and Bigham, J.P. (2014). Tracking @stemxcomet: teaching programming to blind students via 3D printing, crisis management, and Twitter. Proceedings of SIGCSE ’14, ACM, to appear. [PDF]
  • Kane, S.K., Morris, M.R., and Wobbrock, J.O. (2013). Touchplates: low-cost tactile overlays for visually impaired touch screen users. Proceedings of ASSETS '13, ACM, 8 pages. [ACM] [PDF]
  • Hubble images become tactile 3D experience for the blind. ScienceBlog. January 19, 2014.
augmented communication device on a tablet

Communication support for people with aphasia

People with aphasua often experience challenges with written and spoken communication. We are developing new technologies to improve their communication ability via context-aware computing and accessible gestures.

  • Kane, S.K., Linam-Church, B., Althoff, K., and McCall, D. (2012). What we talk about: designing a context-aware communication tool for people with aphasia. Proceedings of ASSETS '12, ACM, 49-56. [ACM] [PDF]
Adaptive user interface running on a UMPC

Adaptive mobile user interfaces

We designed adaptice user interfaces for individuals with motor impairments, along with non-disabled mobile device users.

  • Kane, S.K., Wobbrock, J.O. and Smith, I.E. (2008). Getting off the treadmill: evaluating walking user interfaces for mobile devices in public spaces. Proceedings of MobileHCI '08. New York: ACM Press, 109-118. Winner of Best Paper Award. [ACM] [PDF]
  • Kane, S.K., Wobbrock, J.O., Harniss, M. and Johnson, K.L. (2008). TrueKeys: identifying and correcting typing errors for people with motor impairments. Proceedings of IUI '08, ACM, 349-352. [ACM] [PDF]
  • Froehlich, J., Wobbrock, J.O. and Kane, S.K. (2007). Barrier Pointing: Using physical edges to assist target acquisition on mobile device touch screens. Proceedings of ASSETS '07, ACM, 19-26. [ACM] [PDF]
screenshot of a video game

Making video games accessible to novice gamers and people with motor impairments

We are designing software tools to enable users to dynamically change the features of their game controller, which can help novice gamers as well as people with motor impairments.

  • Said, K. and Kane, S.K. (2013). Button Blender: remixing input to improve video game accessibility. Extended Abstracts of CHI ’13, ACM, 43-48. [ACM] [PDF]
Previous projects
Bonfire prototype on a laptop

Micro-projected user interfaces

We designed prototype user interfaces that use micro-projection and computer vision to make ordinary surfaces interactive.

  • Kane, S.K., Avrahami, D., Wobbrock, J.O., Harrison, B., Rea, A.D., Philipose, M. and LaMarca, A. (2009). Bonfire: A nomadic system for hybrid laptop-tabletop interaction. Proceedings of the ACM Symposium on User Interface Software and Technology (UIST '09). New York: ACM Press, 129-138. [ACM] [PDF]
  • Rosenthal, S., Kane, S.K., Wobbrock, J.O. and Avrahami, D. Augmenting on-screen instructions with micro-projected guides: when it works, and when it fails. Proceedings of Ubicomp ’10, ACM, 203-212. [ACM] [PDF]
  • Gregory T. Huang. Intel Labs Seattle shows off new sensing interfaces, self-charging robot, wireless power. Xconomy. September 29, 2009. [Online]
iPhone web browser

Cross-device user interfaces

We investigated how smartphone users browsed the web on their mobile device, and how they shared web information between their PCs and mobile devices.

  • Kane, S.K., Karlson, A.K., Meyers, B.R., Johns, P., Jacobs, A. and Smith, G. (2009). Exploring cross-device web use on PCs and mobile devices. Proceedings of INTERACT '09, Springer, 722-735. [Springer] [PDF]
  • Karlson, A.K., Meyers, B.R., Jacobs, A., Johns, P. and Kane, S.K. (2009). Working overtime: patterns of smartphone and PC usage in the day of an information worker. Proceedings of Pervasive '09, Springer, 398-405. [Springer] [PDF]
Image of central park from our Envisioning Cards design

Value Sensitive Design

My work with the Value Sensitive Design Resarch Lab explored tools and methods for exploring and engaging with human values during the design process.

  • Kahn, P.H., Jr., Freier, N.G., Kanda, T., Ishiguro, H., Ruckert, J.H., Severson, R.L. and Kane, S.K. (2008). Design patterns for sociality in human-robot interaction. Proceedings of HRI '08, ACM, 97-104. [ACM] [PDF]
  • Nathan, L.P., Friedman, B., Klasnja, P., Kane, S.K. and Miller, J.K. (2008). Envisioning systemic effects on persons and society throughout interactive system design. Proceedings of DIS '08, ACM, 1-10. [ACM] [PDF]

← Home