nxtAIM
NXT GEN AI METHODS – Generative Methods for Perception, Prediction, and Planning
Start: 01/2024
End: 12/2026
In the NXTAIM (NXT GEN AI METHODS) project, FZI collaborates with partners from industry and academia to investigate generative AI methods and world models for automated driving. The overall objective is to use generative methods to introduce a bidirectional flow of information into the processing chain of automated driving functions and, on this basis, develop foundation models for driving data. FZI contributes research on generative models for sensing, world models, language models, and planning, as well as data from its CoCar NextGen research vehicle.
The research project nxtAIM – NXT GEN AI METHODS develops generative AI methods for the next generation of autonomous driving functions and systems. It focuses on foundation models and world models that represent traffic situations and their evolution over time, while generating realistic sensor data and scenarios. These models provide a basis for simulation, training, and validation, enabling targeted investigation of rare and safety-critical situations.
Another key focus is federated learning of generative models using distributed datasets. This approach aims to enable joint training on data from multiple partners while keeping the data with the respective partners. The project’s objective is to develop generative AI, world models, and foundation models to support the development of autonomous vehicles.
Within the project, FZI focuses on methods for the development of foundation models for autonomous driving, including the development and further refinement of generative models to incorporate contextual information into decision-making, as well as research into reasoning capabilities for autonomous driving. FZI also investigates how generative AI methods can improve perception, trajectory prediction and planning for autonomous vehicles, as well as the mapping of road segments. Data curation and processing methods developed within the project, such as AI-based approaches to generative semantic anonymization of large datasets and semantic search capabilities, contribute to the practical implementation of the project.