Exploring multimodal feedback for an NFC-based mobile shopping assistant

This paper explores how mobile devices can provide useful multimodal feedback during interactions with NFC-tagged objects. We exemplify our approach with a mobile shopping assistant that uses haptic-visual and audio-haptic feedback to inform diabetics about the agreeability of tagged grocery products. A preliminary laboratory study shows a preference for haptic-visual feedback which is regarded as more helpful, easier to learn and more pleasant to use. The results stress the usefulness of multimodal feedback for mobile interactions with NFC-tagged objects in this context and inform future work, e.g. about the expressiveness of different feedback modalities and patterns.