Many complex tasks may require a remote expert to assist a local user or guide his or her actions in the local user environment. Existing solutions also allow multiple users to collaborate remotely using high-quality Augmented Reality (AR) and Virtual Reality (VR) head-mounted displays (HMD). In this paper, we propose a portable approach to remote collaboration, with the integration of AR and VR devices, both running on mobile platforms, to address the challenges of existing approaches. The AR mobile platform processes the live video and measures the 3D geometry of a local user's local environment. The 3D scene is then relayed and remotely displayed on a mobile VR device, along with a simple and effective user interface, which allows a remote expert to easily manipulate the 3D scene on the VR platform and guide the local user in complete tasks in the local area.

Please take the opportunity to connect and share this video with your friends and family if you find it helpful.