Interaktionstaxonomie AR
This page is a sort of lookup table of different modes of interaction using Augmented reality.
- Taxonomie AR-Interaktionsräume und -möglichkeiten
- Input - technical
- exposed in unity:
Touch Multitouch Parsing Textfield Timer Time
GPS (location) Gyroskop Accelerometer Light Input ARCore (position) Image Marker 2D (pixelcluster - ARCore, Vuforia) Object Marker 3D - non-moving (Object Targets - Vuforia)
- networking:
WiFi Network strength Cellphone Network Coverage Network SSIDs Network commands (OSC) Bluetooth Beacon
non-trivial: Gesture recognition Voice Object Classification (ML - Tensorflow) Face Tracking (OpenCV - ML Tensorflow) Body Segmentation (ARKit only - for now)
- Input - human
- general:
Shake phone Turn around Inspect Object Inspect Image Walk to Location Turn on/off Flashlight Talk to phone Talk to other Person
- specific:
cast magic start tricorder analysis throw virtual pokeball go to the virtual representation of the Planet Pluto stand inside the particle stream do a sensor sweep engage warp drive run away from spiders throw rock at spider magnify spider send message in a bottle remove your own shadow (skill level five thousand) level up (from skill level fourthousandninehundredandninentynine) answer a question ask a question answer a riddle solve a puzzle ...
- Output - technical
- direct:
Text appears/disappears on screen Mesh appears/disappears on screen Skinned Mesh Animation starts/stops Play/Stop Animation Move Camera UI appears/disappears Sound gets played/stopped Video starts/stops Phone vibrates/stops vibrating Send Network message Camera turns on/off App closes/starts
- indirect:
Simulation gets updated Method of Interaction changes World State changes (Portal opens, etc…)
- Output - human
- general:
- Output - human
receive a question receive information receive new mode of interaction receive new task receive message from other human hear/read someone’s thoughts listen to music see a specific place watch a movie look at a different time look at a different place
- specific:
be in the center of the universe stand on Mars Travel through Wormhole Move Towards Black hole feel Neutrinos