World Labs, a startup founded by renowned AI researcher Fei-Fei Li, has unveiled its groundbreaking AI system capable of creating interactive 3D scenes from just one photograph. While many AI tools can convert photos into 3D environments, World Labs’ innovation stands out by making these scenes interactive and modifiable.
In a blog post, World Labs explained the system’s unique capability: “It allows you to step into any image and explore it in 3D. Beyond the input image, everything else is generated.” Users can try a demo on the company’s website, where these scenes are rendered directly in a browser. The demo includes features like a movable camera and adjustable depth of field, which blurs background objects to mimic real-world focus effects.
The AI-generated scenes are part of an emerging technology category called "world models." Unlike earlier models, which often struggle with low resolution, inconsistency, and rendering errors, World Labs’ approach ensures stability. Once generated, scenes maintain their structure and follow basic physical principles, providing a sense of depth and solidity. Additionally, users can apply effects like changing object colors or adjusting lighting dynamically.
World Labs acknowledges that its system is still in its early stages. The scenes currently limit user movement to a small area, and occasional rendering glitches occur, such as objects merging unnaturally. Despite these limitations, the company is actively working to improve the technology, including enhancing the size and realism of the generated worlds and exploring new ways for users to interact with them.
World Labs believes its technology will significantly impact industries like gaming, filmmaking, and design. While most generative AI tools focus on creating 2D images or videos, this system’s ability to produce 3D content offers greater control and consistency. According to the company, this approach could revolutionize the way digital environments are created, making them more accessible and cost-effective.
The startup has ambitious plans, aiming to release its first product by 2025. It has already raised $230 million in funding from major investors, including Andreessen Horowitz, Intel Capital, and AMD Ventures. With a valuation exceeding $1 billion, World Labs is developing tools tailored to professionals such as game developers, filmmakers, designers, and engineers.
In a podcast episode, co-founder Justin Johnson highlighted the potential of the technology: “Creating virtual, interactive worlds today requires enormous resources and time. World models will make it possible to generate fully simulated, interactive 3D environments quickly and efficiently.”
While still a work in progress, World Labs’ AI system offers a preview of how technology could reshape industries that rely on 3D modeling and simulation. As the technology evolves, it promises to lower barriers to creating immersive, interactive digital worlds, unlocking new possibilities for artists, developers, and storytellers.