Designing Mixed Reality Supported Physically Embedded Workflows



Physically embedded data refers to data within a user’s environment and workflow that is disconnected from existing IoT systems. Such data is difficult for digital systems to track and currently lacks meaningful representation. Mixed reality technology can be used to gain access to physically embedded data and represent it to users in context. This allows for greater understanding of a user’s environment and workflow, which can ultimately lead to greater support by the system, allowing users to achieve their outcomes more effectively. However, mixed reality technology is still in it’s infancy and many vital questions surrounding the design of such systems remain unanswered. What are the opportunities and challenges for mixed reality supported physically embedded workflows? We approach this question from an HCI perspective and seek to model physically embedded workflows by conducting an ethnographic study in collaboration with Agilent Technologies.