The majority of our experience with technology and the internet has been through Glass rectangles and GUI. This currently dominant paradigm will increasing be supplemented by Voice - Command and Control.

NOTE : The two greatest forms of inter - operability are the spoken word and the paper bank note ( paper rectangles - that's another course).



Phone screen evolution and full shift away from buttons to touch.

What happens to public touch screens in the Covid19 age ?

Wikipedia defines Mixed Reality Display Technologies this way.

https://en.wikipedia.org/wiki/Mixed_reality#Display_technologies

This is a reasonable if some what simplified representation. Lets look at some other forms of expressing visual data - strictly speaking GUI - we'll get to voice in a bit.

One path is Heads Up Display or HUD.

Click on the image or link to see the Navdy demo video. https://www.youtube.com/watch?v=q4VX5_m8zMc

How many forms of HCI did you see in that Video ?

• Visual - but PROJECTION not a traditional screen.
• Audible in both directions - spoken & heard.
• Hand gestures - NOT touch.
• An earlier version of their videos hints at Speech to Text and Text to Speech.

To see the early Navdy explainer video - click below.

https://www.youtube.com/watch?v=pKL4PJICS40

You can see from that wiki page and the examples above that display and information for some time now has begun to break out of the Glass Rectangle Projection offers new freedoms, locations and very subtle forms of Mixed ( or Merged ) Reality - MR - with out wearing anything.

Projection Mapping or Projected REALITY.

Lightform.

Very cool San Francisco company is bring complex AV - Audio Visual - technology to the mas market.

click in and watch the demo video - Projector, Computer and Camera - all in one. Once into their site - you will need to scroll down a little to get to their explainer video.

https://lightform.com/