Workflow

* Before beginning, please ensure the hearing impaired or deaf person is wearing the HoloLens.

1. Start application

2. Choose ‘Learn’ or ‘Converse’ mode or quit.

3. If ‘Learn’ go to step 13.

4. If ‘Converse’ go to step 6.

5. If Quit go to step 21.

6. Tap to place bot anywhere. Preferably next to speaker.

7. Bot starts listening. Input speech.

8. Internal processing of converting speech to text.

9. Display American Sign Language gestures on the visor of the HoloLens.

10 Choose whether to ‘Relocate’ or go ‘Back’.

11. If ‘Relocate’, go to step 6.

12. If ‘Back’, go to step 2.

13. Scan environment.

14. Tap to place bot. Bot is mapped to the nearest horizontal surface.

15. Bot starts listening. Input speech.

16. Internal processing of converting speech to text.

17. Display American Sign Language gestures on the visor of the HoloLens.

18. Choose whether to ‘Relocate’ or go ‘Back’.

19. If ‘Relocate’, go to step 14

20. If ‘Back’, go to step 2.

21. Stop.

Workflow.png