Real-World Landscapes in a Game World? The Fusion of Project Genie and Street View
Google DeepMind has announced a new feature where its general-purpose world model, 'Project Genie,' integrates with Google Street View's nearly 20 years of image data. This allows users to generate interactively operable virtual worlds, starting from specific real-world locations. For example, users can transform familiar cityscapes into black-and-white movie scenes, or sink famous tourist spots underwater to explore them, enabling creative experiences. This new feature is being rolled out globally to Google AI Ultra subscribers.
Technical Details
At the core of Project Genie is a world model called 'Genie 3.' This model does not merely generate static images or videos; it understands the physical laws of the world and interactions between objects, dynamically generating environments in real-time in response to user actions. This update leverages Street View's vast real-world image data, exceeding 280 billion images. Through a technology called 'Maps Imagery Grounding,' Street View images are linked with Genie's generative capabilities, enabling the creation of virtual environments grounded in real-world geographical information. When a user selects a location on a map and specifies a style or character, Genie uses this information to generate an interactive scene starting from the chosen location. This is not a pre-rendered 3D scene; instead, it's an innovative approach where AI predicts the next landscape based on the user's movements and continuously constructs it in real-time.
Impact and Prospects for Engineers
The integration of Project Genie and Street View holds immense potential for engineers, including those in Japan. The ability to create realistic 3D environments with a single prompt, which previously incurred immense costs and time, could fundamentally change the landscape of game development. Furthermore, in the development of autonomous driving technology, just as Waymo already uses Genie to simulate rare road conditions, it can provide extremely realistic and affordable learning and testing environments based on the real world. Moreover, its applications are immeasurable, extending to urban planning simulations, disaster evacuation drills, and new forms of entertainment content creation. It's also noteworthy that Street View's data provides a significant competitive advantage, making it difficult for other companies to easily imitate. Although this technology is still in the experimental prototype phase, this innovative step, blurring the lines between simulation and reality, will open new doors for creation for engineers across all fields.
📦