Andrew Guagliardo SphereGen Technologies LLC Mixed Reality Developer

In the Mixed Reality Shell, there is a voice command to remove the hand ray visualization, it is "Hide Hand Rays" and "Show Hand Rays". There doesn't appear to be a similar command for remote assist. Several of our training sessions with clients who are deploying remote assist resulted in a request for this capability. Some users find the hand rays distracting if they are always on and would rather have the ability to toggle them on and off as needed. Most of them navigate remote assist using voice commands and near interactions only.

The underlying spatial map used for placement of objects for remote assist is a powerful feature, but often times when objects or drawings are not placed properly it is a cause for confusion for newer users who are not as technical as developers and those who work closely with Hololens 2. It would be helpful if there was an option to provide a visualization of the spatial mesh during a remote assist call, as well as provide tools before a call starts to choose the desired resolution of the generated spatial mesh. Certain Remote Assist deployments could benefit from a higher density spatial mesh, while others could benefit greatly from a visualization to inform them of the Headset's current understanding of their environment.

We have had success with guides, but we also have use cases where we need to present completely virtual guides, almost exactly like the Demo of Guides. At the moment Guides does not seem to support a hologram maintaining the exact same position / orientation across multiple steps. We currently need to hand place holograms that need to be in the same location across multiple steps and this leads to small inaccuracies over time. It would be very useful to have an option to anchor a given hologram that was placed in a particular step and mark that it should maintain visibility and position / orientation through all future steps until it is marked as no longer needed in another step.

We have several clients actively using Remote Assist on a daily basis. The start menu appears constantly for them and it is a big pain point. It routinely appears during normal operation, due to users washing their hands, donning gloves, or other activities that involve their hands clasping and coming together. While they are now very familiar with the voice command to close the start menu, this is still quite annoying for them as well as distracting. We are aware that one solution could be to rotate the visor into the up position at certain points to avoid the device seeing the hands and triggering the menu, but this is not possible for them, the visor must stay in the down position and they need to be looking at their hands for these processes. Changing the start menu to only open via the one hand gesture (which requires the user to gaze directly at the button to trigger it) and a voice command would likely resolve this issue. Please see the following link for one of the many examples we have where this is an issue. https://gyazo.com/bbaa6bda21f43c5964fac4e73ef01f27

When users share documents to the HoloLens, the image loads in depending on where the user is looking. Because of the time delay between someone saying they have uploaded a document and the document loading into the HoloLens user's view, these documents often appear in places that are not helpful or even detrimental to the HoloLens user. If the HoloLens application docked, or in some other way placed shared files next to the remote assist panel, it would allow HoloLens users to always know where shared documents will appear when they finish loading, and still allow them the control to adjust and place that panel separately from the Remote Assist Panel once they have finished loading in.

Remote Assist allows Teams Users to share files to HoloLens users, but there does not seem to be a way for HoloLens users to share files with Teams Users. Right now you can take a picture with the HoloLens and share it with the teams users, but if you want to access your own files via one drive, you cannot share them to the Teams Users, you can only view them in the HoloLens. Please allow the HoloLens users to share the same file formats from their attached One Drive, or Local Headset Storage, that Teams Users can share.

In Remote Assist Calls we find the additional video feeds and markers distracting and unhelpful for some of our calls. It actively blocks part of the view from the HoloLens user as well, especially when there are multiple users on a call. The entire bottom row of the other participants, with their video feeds and icons blocks part of the video from the HoloLens and is also very distracting. We would like an option to either move these video feeds to the top of the teams view or have the option to have no icons at all? We have noticed that on the Teams Client for Mac the video feeds are shown on top during a remote assist call, and none of the HoloLens user's view is cut off by the video feeds or icons of other users. This is exactly what we want! But, Remote Assist does not support Annotations on the Mac Teams Client....