Audio
Sound can an important element of a virtual environment experience. Virtools supports surround sound output allowing you to associate sounds to 3D objects in the scene.
In addition, plugins such as the Spectrum Analyser provide the ability to listen to external inputs such as a microphone, and use the amplitude and frequency to control elements in the scene.

Magnificat III

Video
Virtools supports video input. Video files can be mapped on to surfaces like textures or displayed in a frame.
Video can be AVI files, streamed from an internet location, or can be a live feed from an attached web cam or firewire camera.

Video tracking and machine vision is becoming one of the most prominent and flexible methods for gesture-based input systems.
As an input "device", advanced scripting could read values of pixels in the video texture and do image analysis.
Use of other programs such as Processing or MAX/MSP Jitter could be done for video tracking, and sending the tracking messages to Virtools through MIDI or Open Sound Control (OSC).

Multi Touch Workbench

Responsive Screen

Motion Capture
This is a general term that covers a broad territory. The video tracking examples above can be considered motion capture, as well as devices that could be connected to MIDI input or hacked joysticks.

VICON System
ACCAD's large-scale optical motion capture lab uses a VICON system. There is a Virtools plugin that supports live input from this system. This requires familiarity with the ACCAD mocap lab.


5DT Data Glove
ACCAD has one of these. A custom plugin has been written for use with Virtools. The bend values of each finger as well as a system of auto-recognized gesture poses is implemented in the plugin.


TrackIR
ACCAD has one of these (very inexpensive) gadgets. It uses infrared imaging to see the reflector clip worn on the users head. It can track rotation of the head as well as position within a limited range. It has been tested with the user standing up in front of a large projection screen as well. The TrackIR emulates a mouse input or can be used to emulate a joystick when a virtual joystick is installed on the system.


Polhemus Fastrak
This is a magnetic field-based device with up to four sensors with very accurate rotation and position detection (6DOF or six degrees of freedom).
A custom plugin has been written for Virtools that requires a VRPN server to be running (Virtual Reality Peripheral Network). It is easy to set up and use.


Emagin Z800
This head-mount display (HMD) provides immersive sterescopic vision, but also includes a head tracker that provides 3DOF rotation. (Currently it can be used with Virtools with the mouse emulator to provide pitch and heading, if we can get a plugin working using the SDK, we can have banking as well).


Wii
Of course the Wii remote. Using GlovePIE and a bluetooth connection, a Wii remote can be used as an input device on a PC. You'll need to provide your own Wii Remote, as I need mine at home at a moment's notice.

Touch Screens
ACCAD does not currently have any touch screens available for general use. However there are many options available for a variety of sizes and applications, including clear panels that can be attached to the front of an existing monitor for a few hundred dollars.

Tartarus