• Roblox has built an AI model that can quickly translate 16 languages in chat.
  • Roblox built a large language model (LLM) based on transformers, and then placed the LLM in a Mixed Expert (MoE) architecture, which allowed the program to save resources without reducing the strength of user privacy protection.

Easy conversation

Roblox has built an A.I. model that can translate text chats so quickly that users won’t even notice at first that it’s translating other players’ messages. It supports 16 languages, including English, French, Japanese, Thai, Polish and Vietnamese.
The goal is for Roblox users to be able to understand what they’re saying so they feel more at ease in their interactions, Roblox CTO Dan Sturman told The Verge. The translator automatically translates the chat content, but the user can click on the icon to view the original message.

“We know that engagement increases when users speak in their own language or interact with others.”

Dan Sturman, Roblox CTO

“We took the concept and eliminated the language barrier with automatic translation.”

How they do

Roblox starts by building a large language model (LLM) based on transformers, which is trained on both publicly available and in-house data. It places LLM in a Hybrid Expert (MoE) architecture, which is an environment that runs multiple translation applications, each of which is an expert in one language.This allows Roblox to save resources without having to build separate LLMS for each language. Stulman says that given the size of their project, his team decided it would be easier to build their own model than modify an off-the-shelf LLM.
Roblox monitors chat logs (for trust and security reasons) and gets feedback if the translation isn’t completely perfect, Sturman says. He added that the addition of chat Translator AI “will not change our privacy and security processes, and prohibited words will still be blocked.”

Also read: China approves more than 40 AI language models for public use

Related

Roblox has been trying to appeal to older audiences for the past few years, using generated AI models to enhance the user experience. Last year, the company launched an AI-powered chatbot assistant for developers. It will also automatically image assets (such as building the text on the) translated into the user’s default language.