Generative AI on Roblox: Our Vision for the Future of Creation

Today, that process requires access to Studio or our UGC Program, a fairly high level of skill, and multiple days of work to enable facial expression, body movement, 3D rigging, etc. This makes avatars time-consuming to create and has, to date, limited the number of options available. Earlier this year, we shared our vision for generative artificial intelligence (AI) on Roblox and the intuitive new tools that will enable every user to become a creator. As these tools evolve rapidly across the industry, I wanted to provide some updates on the progress we’ve made, the road that’s still ahead to democratize generative AI creation, and why we think generative AI is a critical element for where Roblox is going. “We envision the community as a force multiplier for generative AI, creating an ecosystem that our creators and users can leverage to create content and tools more effectively,” he said. With Roblox Studio, creators have the chance to use out-of-the-box and free tools to build their experiences and publish immediately on all popular platforms, reaching as many as 58.8 million people daily worldwide, he said.

But can new technology do what today’s political leaders have failed to do and restore faith in the American political system? Americans—with unseen assistance from the algorithms that now run our digital lives—increasingly live in different political universes. Some 69 percent of Republicans now believe US president Joe Biden lost in 2020, while upwards of 90 percent of the GOP thinks news outlets intentionally publish lies. On the other side, 85 percent of Democrats think former president Donald Trump is guilty of interfering with the 2020 election.

Revolutionizing Creation on Roblox with Generative AI

Next, we leverage 3D semantic segmentation research, trained on 3D avatar poses, to take that 3D mesh and adjust it to add appropriate facial features, caging, rigging, and textures, in essence, making the static 3D mesh into a Roblox avatar. Finally, a mesh-editing tool allows users to morph and adjust the model to make it look more like the version they are imagining. And all of this happens fast—within minutes—generating a new avatar that can be imported into Roblox and used in an experience.

Ultimately, we were able to build an in-house custom voice-detection system by using ASR to classify our in-house voice data sets, then use that classified voice data to train the system. More specifically, to train this new system, we begin with audio and create a transcript. We then run the transcript through our Roblox text filter system to classify the audio.

Roblox is putting its own spin on video chat

The Roblox Assistant can also help with coding and answer questions about developing on Roblox, which could be useful tools for creators on the platform. Developers at Supersocial, a company that makes Roblox games for lifestyle brands, have been using a tool called MidJourney to test out new designs for in-game objects. MidJourney is one of several new art tools that use AI to generate images in response to a text prompt. “It’s at an early stage, but it creates Yakov Livshits ways to build more innovatively,” says Yonatan Raz-Fridman, Supersocial’s CEO. Technology dubbed generative AI has captured attention and investment over the past year by showing that algorithms can produce seemingly coherent text and aesthetically pleasing images when given a short text prompt. The technology relies on AI models trained with lots of data, in the form of text or images scraped from the web, and is also at work in the viral chatbot ChatGPT.

The vision is to empower creators with the flexibility to build subscription-based offerings and business models — ultimately, Roblox wants them to be able to monetize in the way they think is best for their business. For developers, an application programming interface (API) supports building experiences for communication enabling synchronous avatar communication into any experience on Roblox. Roblox is offering a suite of API’s and functionality to support developers to build experiences for communication and connection. It’s an immersive 3D communications experience that the company will open source for its creator community.

More Engaging Games and Experiences

Next year, Roblox plans to update the creator marketplace fees to enable asset and tool creators to keep 100% of the proceeds from the sale of their items—excluding tax and payment processing fees, Bronstein said. Sturman said generative AI learns the underlying patterns and structures of data and generates new content, such as images, audio, code, text, 3D models or other forms of media, that have not been seen before. By introducing more randomness and unpredictability, generative AI can create new challenges and outcomes every time the game is played. This feature increases the longevity of games and experiences and keeps players coming back for more.

Yakov Livshits
Founder of the DevEducation project
A prolific businessman and investor, and the founder of several large companies in Israel, the USA and the UAE, Yakov’s corporation comprises over 2,000 employees all over the world. He graduated from the University of Oxford in the UK and Technion in Israel, before moving on to study complex systems science at NECSI in the USA. Yakov has a Masters in Software Development.

It could very well be that these avatar-based communication tools and generative AI-fueled creative additions are what’ll be the backbone for that next wave of Roblox AR that’ll inevitably come. Roblox has already made its way onto Quest VR headsets, launching in beta this year and now moving to a final version on Meta’s app store this month. Roblox just said at its developer conference that the app is arriving on the PlayStation in October, a move that further pushes the platform’s multiverse of little gaming worlds beyond phones, tablets and PCs.

Later this year, developer-configured text filters will provide developers with tools to decide what type of text is appropriate for their community and experience. This work is just part of our ongoing investment in the technology and workflows that create safe, civil, and thriving communities for everyone. And we have heard loud and clear the feedback from our community about Creator Marketplace fees. Next year, we plan to update our Creator Marketplace fees to enable asset and tool creators to keep 100 percent of the net proceeds from the sale of their items in Studio or Creator Hub—excluding tax and payment processing fees. Also coming next year is the ability for developers to sell models in addition to plugins, and a change to buy and sell assets in U.S. dollars instead of Robux, thus eliminating any Roblox platform fees.

The integration of Gen AI within Roblox’s platform assures enhanced efficiency and creativity, setting the stage for future game development breakthroughs. Corazza refers to Roblox’s own metaverse, and its hundreds of millions of users, as an example. “Until now, just the scale of content that was needed was not met,” Corazza says, referring to metaverse platforms. Beyond conversational AI and rapidly evolving art tools, it’s the way AI is moving into being a copilot for coding that grabs me the most.

? Roblox Is Bringing Generative AI to Its Gaming Universe

Image Generation is a process of using deep learning algorithms such as VAEs, GANs, and more recently Stable Diffusion, to create new images that are visually similar to real-world images. Image Generation can be used for data augmentation to improve the performance of machine learning models, as Yakov Livshits well as in creating art, generating product images, and more. The company is also debuting a digital assistant intended to help Roblox users more easily create content in the online universe by using a more conversational approach, similar to artificial intelligence tools like OpenAI’s ChatGPT.

• Beyond conversational AI and rapidly evolving art tools, it’s the way AI is moving into being a copilot for coding that grabs me the most.
• Stefano Corazza, former VP of Adobe’s AR division and current head of Roblox Studio, explained that the new AI features in Roblox are meant to enhance the productivity of users familiar with coding.
• We are committed to using diverse and robust data sets to limit biased content and encourage safe and high-quality content output.
• With its acquisition, ChatGPT is set to solidify its position as a leader in the AI chatbot market.
• In an interview with The Verge, Roblox CTO Daniel Sturman described how the tool might be able to create basic gameplay behaviors like teleporting you to a place if you touch a door.

As we introduce new communication mediums and invite more people to create, scaling our moderation tools is critical. In addition to the suite of tools and services we already offer to support our creators, we’re sharing new ways for creators to earn on Roblox. As we shared in our vision for the Roblox economy, we support one of the world’s largest virtual economies.

With a possible explosion of devices in AR and VR, Sturman said the company feels very well prepared to move to new platforms. He said Roblox has grown from 36,000 servers in 2021 to 135,000 servers now, or four times as many. “As we do this, we remain aware of the need to implement generative AI thoughtfully and ethically on the Roblox platform, in line with the value we have always placed on respecting our community. We are committed to using diverse and robust data sets to limit biased content and encourage safe and high-quality content output,” he said. Roblox sees a huge opportunity for the AI community itself to become creators on the Roblox platform.

By automating the creation of content, developers will be able to focus on other aspects of game development, such as gameplay mechanics and user interface. According to the article, the use of generative AI will allow Roblox to create a more personalized experience for its users. For example, if a user frequently plays games with a certain theme, such as space exploration, the generative Yakov Livshits AI will create more content related to that theme. Roblox is also building the tools for developers to create recurring subscriptions within their experience. This will be available later this year, said Manuel Bronstein, chief product officer at Roblox, at RDC. There are already a variety of ways to connect and communicate on Roblox like notifications, contact invites, and chat.