AI face and voice controls can supplement adaptive controllers
Published:
In short
GOAT / Open Assistive Tech has published an overview of how AI-based software can turn a webcam and microphone into additional game controls. The article covers Google Project Gameface, PlayAbility for Windows, VoiceBot, VoiceAttack, and AutoHotkey. In a hands-on test, PlayAbility was used to map facial expressions to actions in Diablo 4, including a health potion, evade, and one skill.
For players who need alternative input methods, these tools can reduce physical strain and supplement adaptive controllers. For blind and low-vision players, this is still only one part of accessibility: the game itself still needs to be checked for screen-reader support, audio information, menu narration, and navigation without sight.
Source: GOAT / Open Assistive Tech: Face and Voice as a Joystick.