哥伦比亚研究人员建造了一个26个摩托机器人脸孔, 通过使用人工智能的视频学习嘴唇合成, 改善了人类与机器人的互动。
Columbia researchers built a 26-motor robot face that learns lip-syncing from video using AI, improving human-robot interaction.
哥伦比亚大学的研究人员创造了一个机器人脸孔, 上面有26个运动器, 通过在视频上观察人类, 通过人工智能, 将声音与现实的嘴唇运动相匹配, 学会唇合。
Researchers at Columbia University have created a robot face with 26 motors that learns to lip-sync by observing humans on video, using AI to match sounds to realistic lip movements.
该系统通过自我观察和学习语言和歌曲进行培训,可以使嘴唇与不同语言和音调的音频同步,改善人类与机器人之间的自然互动。
The system, trained through self-observation and studying speech and song, can synchronize lips with audio across languages and tones, improving natural human-robot interaction.
尽管某些声音仍然存在挑战,但这项技术旨在通过解决机器人表达方式中的一个关键差距,加强保健和教育等应用中的情感联系。
Though challenges remain with certain sounds, the technology aims to enhance emotional connection in applications like healthcare and education by addressing a key gap in robotic expression.