Interaktionstaxonomie AR
This page is a sort of lookup table of different modes of interaction using Augmented reality.
Taxonomie AR-Interaktionsräume und -möglichkeiten
Input - technical
exposed in unity:
- Touch
- Multitouch
- Parsing Textfield
- Timer
- Time
- GPS (location)
- Gyroskop
- Accelerometer
- Light Input
- ARCore (position)
- Image Marker 2D (pixelcluster - ARCore, Vuforia)
- Object Marker 3D - non-moving (Object Targets - Vuforia)
networking:
- WiFi Network strength
- Cellphone Network Coverage
- Network SSIDs
- Network commands (OSC)
- Bluetooth Beacon
non-trivial:
- Gesture recognition
- Voice
- Object Classification (ML - Tensorflow)
- Face Tracking (OpenCV - ML Tensorflow)
- Body Segmentation (ARKit only - for now)
Input - human
bodily interaction
- Shake phone
- Turn around
- Inspect Object
- Inspect Image
- Walk to Location
- Turn on/off Flashlight
- Talk to phone
- Talk to other Person
cognitive framing
- cast magic
- start tricorder analysis
- throw virtual pokeball
- go to the virtual representation of the Planet Pluto
- stand inside the particle stream
- do a sensor sweep
- engage warp drive
- run away from spiders
- throw rock at spider
- magnify spider
- send message in a bottle
- remove your own shadow (skill level five thousand)
- level up (from skill level fourthousandninehundredandninentynine)
- answer a question
- ask a question
- answer a riddle
- solve a puzzle
...
Output - technical
- direct:
Text appears/disappears on screen Mesh appears/disappears on screen Skinned Mesh Animation starts/stops Play/Stop Animation Move Camera UI appears/disappears Sound gets played/stopped Video starts/stops Phone vibrates/stops vibrating Send Network message Camera turns on/off App closes/starts
- indirect:
Simulation gets updated Method of Interaction changes World State changes (Portal opens, etc…)
- Output - human
- general:
- Output - human
receive a question receive information receive new mode of interaction receive new task receive message from other human hear/read someone’s thoughts listen to music see a specific place watch a movie look at a different time look at a different place
- specific:
be in the center of the universe stand on Mars Travel through Wormhole Move Towards Black hole feel Neutrinos