27 August 2026

Google XR prototype now generates hand gestures for agents

• Google built AgentHands, a system that makes AI agents in virtual or augmented reality move their hands while talking, synchronized with their speech.
• The hand gestures help agents communicate spatial information more clearly, like pointing to objects in the environment around them.
• Early testing shows agents with gestures performed better at warning users about hazards than agents that only spoke.

How it was covered

Deep Learning WeeklyEditorial team

Google XR prototype AgentHands syncs LLM-generated gesture events to speech in spatially grounded agent conversations, significantly improving spatial grounding and warning salience compared to speech-only agents.