Sony's AI Character Brings New Life to Gaming

Sony has taken a big step forward in gaming with an AI-powered character. This character can chat with players during gameplay. Aloy, from Horizon Forbidden West, is the star of this demo. She can answer questions and even give updates on the game's progress. The AI uses voice prompts and facial movements to make the conversation feel real. The technology works well in both controlled demos and the full game. Aloy can tell you where you are and what the time is, though she might not give exact details. The AI character can also provide a summary of what happened during the game. This feature can be useful for players who want to review their progress. However, there's a catch. When Aloy says goodbye and thanks the audience, her robotic voice can feel a bit eerie. This is a reminder that, despite the advances in AI, there's still a long way to go before these characters feel truly human. Sony used several models to create this prototype. GPT-4 and Llama 3 were used for decision-making and conversation. OpenAI's Whisper handles speech-to-text. Sony's own Emotional Voice Synthesis (EVS) system and Mockingbird technology were used for speech generation and audio to face animation. These technologies are still relatively new and not widely known. Other companies are also working on similar technology. NVIDIA has its ACE suite, which brings AI-powered conversations to game characters. Microsoft is also involved in this field, showing that AI in gaming is a hot topic. However, not everyone is impressed. Some people find these AI demos unsettling, highlighting the challenges in making AI characters feel natural. AI in gaming is still a work in progress. While it brings exciting possibilities, it also raises questions about how we interact with these characters. As technology advances, it will be interesting to see how AI continues to shape the future of gaming.