Defining good safety, functional and performance requirements for completely driverless cars has been an industry struggle since the inception of self-driving vehicles. How do manufacturers set real targets and goals for performance and safety instead of chasing 'better' for eternity? A combination of traditional big systems engineering and new methods of verification for machine learning systems will help pave the way for manufacturers to responsibly demonstrate 'good driving'. We will discuss the methods used at Uber ATG and where we hope to see the industry move in the near future as live deployments become reality.
Virtual testing for autonomous vehicle validation and certification
Dr Andras Kemeny Expert leader immersive simulation Renault FRANCE
Autonomous vehicle validation for both engineering design and public acceptance will require the development of comprehensive testing and certification methodologies. In view of the large number of driving miles to check for robust and efficient autonomous driving models, the use of driver-in-the-loop and high-performance computing simulation is mandatory. The new validation methodologies to be introduced for virtual testing are under extensive development today by automotive companies and certification bodies. High-performance virtual environments corresponding to the test scenarios are to be built, as well as new validation tools guaranteeing high-fidelity correlation between field and virtual testing.
Dr Jaya Shankar Program head, smart mobility solutions Singapore Technical Committee for Autonomous Vehicles, Institute for Infocomm Research (A*STAR) SINGAPORE
This session covers a set of provisional national standards that was launched in January 2019 to guide the industry in the development and deployment of fully autonomous vehicles (AVs). Known as TR 68, Technical Reference 68 will promote the safe deployment of fully autonomous vehicles in Singapore. As an industry-led effort, comprising representatives from the AV industry, research institutions, institutes of higher learning and government agencies, the group has developed standards covering four key areas of AV deployment: vehicle behavior, vehicle functional safety, cybersecurity and data formats. Set as a provisional standard, TR 68 will continue to undergo refinement as AV technology matures and with future feedback from the industry.
10:15 - 10:45
10:45 - 11:45
Panel Discussion - Accelerated development to 'Level 4-5' AVs
As dozens of companies from Europe and China to Detroit and Silicon Valley look to build and deploy Level 4+ autonomous vehicles (AVs) in the coming years, many are looking to specialized horizontal software suppliers to accelerate their internal development process and time-to-market. This panel will feature executives from four such software companies that are bridging the gap between the tech industry and the auto industry.
Mohammad Musa Founder and CEO Deepen AI Inc USA
Jessie Lazarus Head of mobility business development Carmera USA
Tobenna Arodiogbu CEO Scotty Labs Inc USA
Moderator: Qasar Younis, co-founder and CEO, Applied Intuition Inc
11:45 - 12:45
Panel Discussion - Driving adoption at scale - essential activities to 2030
Today trials of self-driving vehicles are gathering pace. But there are still only a small number of experimental vehicles on our roads. What is needed to rapidly scale these limited trials to significant demonstrations and ultimately to market-ready services?
This session will discuss the ecosystem needed to accelerate market adoption of self-driving technologies, with a focus on cross-sector collaboration, emphasizing the importance of harnessing the skills, capabilities and regulations in a common direction and at the right time. The focus will be on the journey needed from the present day to 2030 and the vision needed to maximize the benefits of connected and self-driving vehicles as early as possible.
Chris Reeves Head of connected & autonomous vehicles HORIBA MIRA UK
Peter Stoker Chief engineer, connected & autonomous vehicles Millbrook UK
Andrew Harris Principal engineer West Midlands Future Mobility at University of Warwick UK
Nick Chrissos Director of innovation in EMEAR Cisco Systems UK
Moderator: Richard Porter, director of technology and innovation, Zenzic
Dr Jason Eichenholz Co-founder and CTO Luminar USA
Autonomous mobility is the disruptive technology of our era, and at its core are optical sensing challenges. Getting better data required to operate safely is the key to a driverless future, and this all hinges on new kind of lidar built for self-driving scenarios. Join OSA and SPIE fellow and co-founder of Luminar Jason Eichenholz in a talk on the requirements for self-driving vehicles and a vision for a major breakthrough in lidar.
Invisible integration of solid-state lidar to make beautiful self-driving cars
Kris de Meester Vice president sales and business development XenomatiX BELGIUM
Lidars are still mostly placed on the outside of vehicles. Mass-production adoption will require more aesthetically pleasing integration. Consumers are expecting higher levels of automation without giving up slick car design. As lidars emit and receive specific lightwaves, elements to cover or hide the sensor typically affect their performance. XenomatiX worked together with Tier 1s on integration of its solid-state lidar. A front-view long-range lidar behind the windshield will be presented. The impact of the windshield will be explained, as well as the benefits and challenges of this integration. Example data taken from real-world driving will be shown.
Overcoming the validation challenges for smart video cameras
Davor Kovacec CEO Xylon CROATIA
AI-powered smart automotive video cameras are enabling self-driving vehicles to better perceive their surroundings. Autonomous vehicles will have an estimated 10+ cameras that integrate high-resolution HDR video sensors and vision processors. These systems generate tremendous amounts of heterogeneous data and require innovative new approaches to multi-channel capturing of sensor data for validation. The presentation will give an overview of smart cameras with high-speed serial links, and standard data formats to be used by third-party HIL/SIL platforms. System requirements will vary by OEM, but the design requirements need to support a configurable hardware-based platform for non-invasive capturing of unaltered and accurately time-stamped data.
Bringing the power of radar to autonomous driving
Kobi Marenko Co-founder and CEO Arbe ISRAEL
While OEMs ramp up Level 3 vehicle production, recent AAA testing shows ADAS systems are not ready to handle real-world driving. To achieve L3 and higher autonomy, there is a need for a highly advanced sensor to view roads with ultra-high resolution and a wide field of view – in the hope of resolving ambiguities, achieving low false alarm rates, and coping with mutual interference.This presentation will explain why imaging radar is the only technology that can overcome industry challenges, and discuss the role radar plays in the future of vehicle autonomy and mobility.
15:40 - 16:10
OADF – the cross-domain platform driving standardization in HAD
Martin Schleicher Executive vice president business management Elektrobit GERMANY
Automated driving aims to deliver on two key promises to consumers – mobility and comfort – allowing us to make better use of our time when we drive from A to B. Furthermore, increased safety will result in fewer accidents and traffic-related casualties. A network effect that is driven by the exchange of sensor data, traffic/safety information and map data across the automotive industry players is needed. Learn more about the goals and achievements of the OADF with its members Adasis, NDS, Sensoris and TISA – and how you can participate and add to the network effect to fulfill the promise of automated driving.
Safety-focused lidar solutions and opportunities in testing and validation
Dr Mircea Gradu Senior vice president quality and validation Velodyne LiDAR USA
There is a great need for the AV industry to identify lidar requirements and standardize how to address them. The goal is to have lidar products undergo testing and validation based on the standards early in their product lifecycle, with the results available to auto makers and Tier 1 suppliers. It is necessary to create specialized tests and validation cases that establish standard ways to determine whether lidar sensors can address industry demand. To be of value to auto makers, all lidar sensors need to be assessed by the same gauge.
FIR technology: from enhanced ADAS to Level 3 and above autonomy
Raz Peleg Director AdaSky ISRAEL
Far Infrared (FIR) technology is experiencing a revolution, with higher resolution, better performance, and lower cost and size. It is ready now for the automotive market to fulfill OEMs' need for a solution capable of detecting and classifying all living and non-living objects in an AV’s near and far driving environment. This presentation will discuss how to use these abilities to enhance current ADAS offerings, paving the way for autonomous driving.
Developing the ultimate perception system for autonomous vehicles
Juergen Ludwig Director of business development Cepton Technologies USA
The automobile industry is trying to determine the ultimate combination of perception systems for safe navigation in autonomous vehicles. The presentation will discuss why the ideal system will rely on lidar sensors for 3D mapping of surroundings, cameras for vision, and radar to determine speed and distance. We will share the pros and cons of each system and how they balance each other out for safe navigation. The session will also cover the challenges of mass production, and the techniques the industry is using for developing lidar sensors that are high resolution, low power, compact in size and low in cost.
Simulation - Validation in the Virtual Domain 09:00 - 12:50
Matt Daley Operations director rFpro UK
Challenges of high-fidelity sensor simulation in SIL and HIL environments
Holger Krumm Product manager dSPACE GmbH GERMANY
Autonomous vehicles are now on the horizon. Functions for autonomous driving have to be test driven over hundreds of millions of kilometers via software-in-the-loop (SIL) simulation to reduce costs and improve test coverage. For development and validation purposes of algorithms based on sensor data, it is necessary to generate synthetic sensor data for the driving simulation. This work presents a powerful integrated and unified toolchain for SIL and HIL testing of autonomous vehicles. It will address challenges for sensor data generation with GPU-based high-performance rendering by state-of-the-art game engines in combination with ray tracing. Future developments will also be outlined.
Leverage hybrid scenario generation for AV certification
Sankar Raman Sathyamoorthy Senior researcher, development engineer QRTECH AB SWEDEN
Soheil Bashirinia Field application engineer ADAS, ESI Nordics SWEDEN
Autonomous vehicles should handle complex, unusual and hazardous scenarios without human intervention. Their certification will require a balance between real and virtual testing. To support both, dedicated SW tools should be interoperable, and easy to use and integrate into innovative test and validation processes. ESI is providing a standalone scenario generation solution using a high-level description language based on OpenSCENARIO, together with an environment to simulate the output from multiple physical sensor systems for outdoor scenarios that combine vehicles, obstacles, pedestrians, weather and road conditions. This presentation will highlight results from pilot projects involving hybrid testing and AV certification.
Application of 'over-the-air' radar stimulation for vehicle-in-the-loop tests
Steffen Metzner Technology scout ADAS, simulation and control AVL List GmbH AUSTRIA
The main test and validation development environment of ADAS and AD functionalities is still the actual vehicle. This time-consuming and expensive method lacks reproducibility and demands a large number of staff depending on the complexity of the scenario. The DrivingCube AVL approach aims to bring a ready-to-drive vehicle into a virtual environment. This enables functional testing independent from weather conditions and daylight, and improves reproducibility. This presentation will show the application of radar stimulation for vehicle tests based on the results of research projects. It will also provide an outlook on radar stimulation for future radar systems.
Training perception software with simulated test drives
Ashish Naik Business development manager – automotive V&V National Instruments UK
There is no question that simulation is the method by which we achieve the billions of miles of driving needed to verify safe operation of autonomous vehicle software. Although we are making great progress in testing path planning and control algorithms, perception testing is still primarily limited to high-bandwidth data recording and playback. This session introduces simulation tools and techniques that augment data playback with simulation that replicates sensors and environments with enough fidelity to test perception algorithms in the lab.
10:40 - 11:10
Pushing the boundaries – simulation vs. the real world
Danny Atsmon CEO Cognata ISRAEL
The greatest challenge for simulation is finding the matrix that compares it to real life. In this session, Danny will present a mathematical matrix that defines this relationship and will show how a proper simulation can be constructed based on deep learning techniques. He will also supply live examples of the Cognata simulation platform.
Keeping it real: using simulation for AV certification
Kirsty Lloyd-Jukes CEO Latent Logic UK
The presentation will provide an introduction to the OmniCAV project, a groundbreaking, multi-year R&D initiative supported by the UK Government to develop a holistic simulation system that enables 'AVs for all'. This project is addressing the most interesting challenges in AV testing, including: can you use a simulation to certify an AV is safe to drive on real roads? What about different road environments, like rural roads vs. crowded cities? How can AV developers protect their IP but still get the regulators on board? Project partners are Latent Logic (lead), Admiral, Aimsun, Arcadis, Arrival, Oxfordshire Council, Ordnance Survey, RACE, WMG and XPI.
Driver-in-the-loop applications with sensor fusion to accelerate ADAS/AD development
Ram Mirwani Director, global business development, ADAS Konrad Technologies GERMANY
As ADAS/AD functionality gains adoption slowly yet surely, the jury is still out on what type of testing is required and, more importantly, how much testing is required. With governmental and focus groups working together on this topic all over the world, OEMS and Tier 1s continue to develop and test ADAS and AD functionality primarily using drive tests and miles on the road as de facto test methods. The paper will discuss how simulators combined with sensor packages for ADAS/AD can be used together in a lab to robustly verify ADAS/AD functionality as a pre-step to ground truthing.
Real-world 3D road scenario corpus for automated driving simulation
Dr Chang Yuan CEO Foresight AI Inc USA
We present a novel approach for generating realistic and comprehensive road scenarios for driving simulation. The road scenario consists of high-definition road map and 3D trajectories of moving objects (e.g. vehicles, bicycles, pedestrians). Both HD map and motion trajectories are captured by our 3D sensor system from the real world, and processed by computer vision algorithms at high accuracy (5cm level). We are building an extensive scenario corpus of on-road behaviors, including unprotected turns, lane changes, merges/exits and pedestrian traffic. Users can call our web APIs to search and download scenario data in the OpenDrive/OpenScenario format into driving simulation environments.
12:50 - 14:00
Test, Verification & Validation Methodologies 14:00 - 18:15
Matthieu Worm Program lead autonomous driving and vehicle dynamics Siemens Digital Industries Software BELGIUM
How to calibrate and test ADAS and AD end-of-line
Thomas Weck Global segment manager AVL List GmbH AUSTRIA
ADAS and AD systems require large-scale testing and validation before vehicles can be released onto the market. While new development processes focus on extensive scenario testing in simulation to cover billions of test miles, vehicle-level testing is important to address integration and confirm the robustness of the sense-plan-act chain. One necessary prerequisite is that all sensors be aligned relative to the vehicle coordinate system. Dürr and AVL have partnered up to consistently transfer testing know-how from development into the end-of-line testbed environment, with the goal of enabling complex sensor calibration and functional testing in manufacturing.
Increasing reliability and efficiency of ADAS data collection campaigns
Alexander Noack Head of automotive electronics b-plus GmbH GERMANY
Testing autonomous systems requires a tremendous number of test vehicles in order to cover the relevant mileage. How can we manage the complexity of these tests? Sensor makers have to ensure that the test vehicles always operate properly, the test systems are configured correctly and the latest sensor software versions are installed. Test drivers sometimes cannot manage the complex test setup with different loggers, data converters, hundreds of cables, etc. An efficient test drive campaign can save a lot of money if it is easy to manage. A central, intelligent management system for test drive campaigns would be desirable.
A regulation-compliant safety framework for the approval of automated vehicles
Dr Houssem Abdellatif Global head autonomous driving and ADAS TÜV Süd GERMANY
Currently there are no general regulations or methods for certification or approval of automated vehicles. However, many use cases or initiatives are struggling to operate automated vehicles on public roads. TÜV Süd has developed a universal framework that copes with the heterogeneous local regulations and provides a unified method for the assessment of automated vehicles. This framework considers local roadworthiness regulations, as well as functional safety and cybersecurity, and can therefore be applied in any region in the world. TÜV Süd has enabled ambitious projects to be successful in operating automated vehicles on public roads, without any safety issues.
Defining and assessing Level 4/5 AV capabilities through physical testing
Niels de Boer Program director, CETRAN Nanyang Technological University SINGAPORE
CETRAN is assessing autonomous vehicles to support the issuance of AV licenses in Singapore. As part of the assessment, not only is safety considered but also ability to drive in conformance with traffic rules and with capabilities similar to those of a human driver, satisfying the requirements for the awarding of a driver's license. However, driver's license requirements are written in a way that is hard to interpret using normal engineering standards. The presentation will show how the minimum capabilities required for the assessment are defined, and how tests are defined, executed and assessed to confirm adherence to these requirements.
15:40 - 16:10
Testing autonomous vehicles in Singapore: from scenarios to tests
In view of recent developments in autonomous vehicles (AVs), the need arises for an efficient AV road-approval procedure. To this end, a safety assessment framework is proposed by CETRAN in Singapore which employs virtual and physical tests. In this presentation, we will explain the process for defining the tests, which includes test criteria that describe what we are evaluating, test cases that describe how we are evaluating the test criteria, metrics for quantitatively expressing the outcome of a test, and references that define when an outcome is acceptable. Additionally, some important lessons learned are provided, from the tests currently being used to assess the safety of AVs that will be deployed in Singapore.
Using portable scenarios and coverage metrics to ensure AV safety
Yoav Hollander Founder and CTO Foretellix Ltd ISRAEL
It is now common practice to use scenarios as one of the main ways to ensure AV safety. The presentation will emphasize the need for scenarios to be portable across the various execution platforms used (test tracks, specific simulators, etc), the various stakeholders (OEMs, subsystem creators, regulators, etc), various use modes (fully random and deterministic), and so on. It will also discuss how coverage and grading metrics play a crucial role in defining scenarios, evaluating the results and ensuring safety.
Safety assessment of automated driver assistance systems using reliability analysis
Maximilian Rasch PhD and engineer Daimler AG GERMANY
Advanced driver assistance systems (ADAS) are being increasingly focused on by researchers and industries as more and more vehicles are equipped with such technology. Testing and validation are essential to reach this goal and release ADAS. Several papers have stated that the mileage required to prove the probability of failure of the system is impossible to reach in field operational tests. Statistical methods such as Monte Carlo simulation combined with software-in-the-loop (SIL) simulation may help to overcome this limitation. The field of reliability analysis provides algorithms and approaches that can be applied to assess ADAS.
Safe autonomous driving: ASTERO pedestrian target and 6D Target Mover
Dr Igor Doric Executive director Messring Active Safety GmbH GERMANY
This presentation will introduce ASTERO, the latest-generation dynamic pedestrian target. Within the TARGETS research project, which was funded by the Federal Ministry of Economic Affairs and Energy (grant number KF2122308DB3), Messring worked in cooperation with CARISSMA Technische Hochschule Ingolstadt on the development of a novel pedestrian target. Based on previous research results, ASTERO is now focused on realistic human motion while providing the required robustness and usability for AEB tests on proving grounds. The presentation will also include the 6D Target Mover test system, which is currently installed on a proving ground in Germany.
Application of scenario-based testing to automated driving systems
Tim Edwards Senior consultant, CAV technologies Horiba MIRA Ltd UK
New CAV applications must be robust to withstand increasingly complex driving situations and diverse environments. The development of methods for the identification and structuring of these potential test scenarios remains a very active research topic. This paper draws on two UK-based collaborative projects, SAVVY and Human Drive, which address L2 and L4 applications respectively. Specifically, we reflect on the experiences from applying state-of-the-art methods to these projects, and mapping system requirements to comprehensive sets of test parameters and scenarios. A further UK project, VeriCAV, has started this year to further develop this work, including the automation of these processes.
Day 2: Wednesday, May 22
V2X, 5G & Connectivity 09:00 - 13:30
Chris Reeves Head of connected & autonomous vehicles HORIBA MIRA UK
Automated driving is demanding more and more advanced tools and methodologies in order to provide robust, cost-effective performance and safety validation. Connectivity, as an enabler of automation, also requires a high degree of performance, especially when AVs will rely on the information received from other road users and the infrastructure to safely navigate in the real world. In this session, Applus IDIADA will present its latest tools and facilities devoted to the testing of connected vehicles, as well as two flagship European R&D projects that will make use of them: ENSEMBLE and HEADSTART.
5G pushes autonomous driving – but technology is not the limiting factor!
Oliver Bahns Head of business area connected mobility T-Systems International GmbH GERMANY
Autonomous driving touches every aspect of future fleets – combined with massive changes in business cases. Deutsche Telekom is participating in various test environments across Europe, covering connectivity, platform operations for development, testing and simulation, as well as business case assessments for cross-industry scenarios. Our project results indicate that 5G and MEC technologies will not be the limiting factor for bringing autonomous driving into broader-scale usage. The key requirement is the transfer of domain knowledge from existing systems integration and big data scenarios into autonomous driving operation platforms. Key topics are over-the-air updates, automotive security and use-case-specific monitoring.
Improving position accuracy and reliability for V2X
Ciprian Manea Field application engineer Savari GmbH GERMANY
Considerable effort has been made to create safer roads, make traffic more efficient and save energy in the transportation system. So far, V2X has proved to be the best technology to deal with these three aspects. One of the key variables in the V2X formula is the positioning subsystem, a functional safety requirement for V2V and V2I applications. Many use cases require decimeter range accuracy and reliable quality information. In this presentation we'll explore how one can improve the accuracy and reliability of the positioning system by using multi-band GNSS receivers, correction services or RTK systems.
Understanding V2X application testing with 3D ray tracing multi-path GNSS simulation
Ricardo Verdeguer Moreno Software engineer Spirent Communications UK
This presentation relates to V2X application performance testing with 3D ray tracing multi-path GNSS simulation. V2X systems use accurate GNSS positioning to provide precise position information for safety. The speaker will discuss how multi-path can create errors in a GNSS receiver within urban environments, and explain how errors can vary due to the geometry of satellites and environmental conditions. The presentation will also explain how testing is crucial for the success of V2X technology, and will include details of a novel system that combines V2X emulation with an advanced GNSS simulator and propagation model, which depends on a 3D reconstruction of real life.
Connected autonomous vehicles – security risks and why blockchain is the solution
George Grama Founder and CEO Autonomy Chain USA
The future autonomous vehicles will communicate on a network with each other, with the smart city and with smartphone apps. But the network cannot be the open internet we use today. There are serious security risks which, if exploited by hackers, could lead to botnets of thousands of vehicles controlled remotely. Most common vehicles on the roads today can be hacked already. It is critical that future CAVs be hackerproof and that the network be able to withstand any attacks. Blockchain is a decentralized technology that can encrypt all access and control of any vehicle, in a network that doesn’t have a single point of failure.
11:05 - 11:50
HIL testing of 802.11p and C-V2X for the connected car
Axel Meinen Technical sales manager S.E.A. Datentechnik GmbH GERMANY
A key issue for highly automated and autonomous driving is the connectivity between the car itself and the surrounding infrastructure via 802.11p and cellular V2X (LTE-V). Due to the safety-relevant functions of most of the components and applications, the mandatory and complex test and validation processes require an open and flexible platform that allows developers to access, analyze and manipulate signals and data in the various implementation phases within the development process. This presentation gives a detailed overview of the various testing approaches and highlights the advantages of an open testing platform.
Vehicle-to-everything technology (V2X) – the key enabler for autonomous vehicles
Dr Alain Vouffo Product manager - automotive Spirent Communications UK
Vehicle-to-everything technology (V2X) is widely accepted as a key enabler for the autonomous vehicle. Beside the IEEE802.11p (a.k.a DSRC)-based V2X technology, cellular-V2X (C-V2X) has been gaining momentum. C-V2X provides vehicle-to-everything communication over the cellular network, based on 3GPP standards like LTE-V and 5G. Despite similarities with 11p-V2X, C-V2X comes with a range of specific test requirements and challenges that must be addressed early for this technology to deliver the expected benefits. This presentation discusses test requirements and challenges in addressing those. It highlights testing methodologies for C-V2X that ensure that new products and solutions are delivered in time.
Cooperative driving function development and testing in a virtual environment
Dr Natalya An Business development manager ADAS and automated driving IPG Automotive GmbH GERMANY
Cooperative ADAS and AD functions, also called V2X applications, rely on various sensor data and reliable wireless communication. A virtual environment enables reproducible, efficient, risk-free testing of V2X applications. During early development stages, neither real radios nor virtual vehicle prototypes are necessary. To study the impact of network protocols and wireless channel properties, a network simulator is often used. In later development stages, the use of radios with full V2X software stacks is essential. This paper shows how an open integration and test platform enables model reuse and supports V2X application development and testing during all stages.
Transatlantic mobility partnerships
Paul Krutko CEO Ann Arbor SPARK USA
Ann Arbor SPARK is working with AMZ Saxony to facilitate the Transatlantic Automated Driving Alliance (TADA). Germany and Michigan are both highly invested in the future of the connected and automated vehicle space, and the industry collaboration across borders can inform the industry standards for Europe and North America. The basic concept of the program is to identify use cases of problems that need to be solved, and then actively recruit all types of companies from startups to Fortune 500s to collaborate on new solutions that can be monetized into new companies or joint ventures.
13:30 - 15:00
Data Management, Storage and Cloud Technology 15:00 - 18:00
Alexander Noack Head of automotive electronics b-plus GmbH GERMANY
Modern hybrid storage solution for sensor data and HIL/SIL simulation
Ingmar Loeke Director sales DACH Qumulo GERMANY
Jochen Kanta Senior systems engineer Qumulo GERMANY
Data rates of modern sensors are constantly growing due to higher resolutions, multiple sensor types and an increasing number of sensors per car. A typical test car today produces 20-30TB per day. Considering a fleet of 10 cars and 200 recording days, the enormous amount of 60PB must be stored, processed and archived. Other requirements are global ingest and global access for annotation, processing and other process steps. In this session we’ll discuss a modern hybrid scale-out solution that uses cloud as well as data-center implementations to address these challenges.
Need speed? Automotive datalogging at 10GBs and more
Bernhard Kockoth Advanced development lead ViGEM GmbH GERMANY
The main driver for high data rates in automated vehicles is growing sensor resolution for better environment understanding. Current setups require a number of high-resolution cameras and radar systems. Compression of data is traded for safety to achieve lowest latency from sensor to drive computers – the car can drive faster! OEMs and Tier 1s require all raw sensor data to train ML on the very same data the central drive computer 'saw' when the vehicle was on the road. We faced the challenges of 10 gigabits and more and present a handy solution for data recording and transfer.
ADAS data gathering 2.0
Richard Levy Director EU Platform UG GERMANY
Arvind Sivasubramanian Project manager EU Platform UG GERMANY
In the development of ADAS, data is generally collected in-vehicle and transferred to a low-cost site for labeling. The collection and transfer process wastes resources and time and creates risk. Data loses value quickly as sensors change. Sharing for fusion projects adds difficulty. Our test platform allows real-time annotation of raw data within the vehicle, and manual correction. We retain the ability to simulate multiple vehicle platforms with the same collected data. The cybersecurity implementation allows work with multiple partners on one vehicle, for example in fusion projects where camera, lidar and fusion components come from competitor companies.
16:15 - 16:45
Integrated data management for efficient validation of autonomous vehicles
Franz Gaber Program manager data management & processing platform CMORE Automotive GmbH GERMANY
Integrating various stakeholders, disciplines and locations into a data management system is one of the key challenges within the development and validation of autonomous vehicles. An intelligent workflow engine is required as well as integration of, and compatibility with, big data technologies. In addition, collaboration between huge teams, e.g. for data annotation and test, and management, must be supported. The presentation will show how CMORE Automotive's modular and highly flexible data management platform addresses these needs.
High-bandwidth datalogging solution for autonomous driving
Andreas Ehrle R&D X2E GmbH GERMANY
With the new bandwidth demands arising from assistance systems and autonomous driving, a new architecture for datalogging devices is needed. The solution is a distributed datalogging system with a central datalogger and additional tap devices that can be located everywhere in the car. They send the data via an Ethernet link to the datalogger. For a high-speed infrastructure, 10GBit links between the datalogger and tap devices are needed. A distributed system like this has many advantages. Tap devices for different bus systems can be chosen and installed as needed for a specific car infrastructure.
Creating an optimized storage environment for autonomous vehicles
Jason Coari Director, high-performance solutions Quantum Storage UK
As organizations focus heavily on autonomous vehicle development, they are quickly learning that there is a massive volume of data rapidly growing in parallel to this activity – data that is extremely valuable and requires access in a time-sensitive manner. Within this context, it is imperative that the industry be better informed of data management solutions for this valuable data. This presentation will focus on how these organizations can create balanced storage architectures that can accelerate the ingest phase of this data from car to data center, and more cost-effectively preserve it over its lifecycle.
Simulation and Test Scenario Validation 09:00 - 12:50
Matthieu Worm Program lead autonomous driving and vehicle dynamics Siemens Digital Industries Software BELGIUM
Testing and validating autonomous vehicles using traffic simulation
Dr Jochen Lohmiller Manager microscopic simulation PTV Group GERMANY
Before testing connected and autonomous vehicles (CAVs) in real traffic on public test areas such as in Karlsruhe, Germany, virtual testing of those test areas using traffic simulation accelerates the development. Advanced traffic simulation models simulate all modes, such as individual human drivers, cyclists, pedestrians and different CAV behavior, which allows testing under different vehicle/driver populations. We present in a case study of how virtual tests can be applied using co-simulations between ego-vehicle simulation and a traffic simulation in the example of signal communication (V2X).
Massive simulation: recent achievements and perspectives
Thomas Nguyen That Head of automotive domain AV Simulation FRANCE
Simulation has a key role to play in demonstrating the safety of autonomous vehicles, enabling billions of miles of virtual driving. This requires dedicated tools and methodologies, scenarios and models for the environment, sensors, and vehicles that are highly representative of the real world. AV Simulation is developing SCANeR studio, a versatile engine for automotive systems simulation. In this presentation we will present our latest experiences with massive simulation and explain how we addressed the challenges of model representativity, scenario generation, massive parallel execution and metrics computation.
Integration of simulation tools in validation processes
Ahmed Yousif Software design engineer Valeo Schalter und Sensoren GmbH GERMANY
The presentation talks about the use of simulation tools to aid the validation of autonomous systems and algorithms. These systems can include lidars, cameras, ultrasonics and radar sensors. The use of simulation tools will help to reach the mileage required to validate the driving assistance systems in Level 4 and 5. In addition, the use of these simulation tools is needed where the artificial intelligence algorithms are exposed. The presentation will include some demos for lidars and ultrasonics-based algorithms such as full automatic parking.
The driver-in-the-loop simulator in the ADAS development and validation toolchain
Jelle van Doornik Product manager ADAS Cruden NETHERLANDS
All car manufacturers are investing heavily in ADAS and AD development; billions of test kilometers are driven in simulation, and proving grounds are built specifically for the development and validation of (semi-)autonomous systems. A driver-in-the-loop simulator is effective to save time and cost, and speed up driver or passenger acceptance. Corner cases with different scenarios and conditions can be evaluated quickly. The challenge is to create an open architecture for engineers to work with in the development, and have standardized interfaces and content available to perform quick validation. This presentation explains how the driver-in-the-loop simulator fits into the total toolchain.
10:40 - 11:10
Machine learning and a systems approach to creating autonomous vehicle test cases
Siddartha Khastgir Principal engineer WMG, University of Warwick UK
To prove automated driving systems are safer than human drivers, it is suggested that they will need to be driven for over 11 billion miles. However, rather than the number of miles it is the quality of those miles that is important. To find the 'interesting test cases', a novel machine learning and systems-engineering-based approach has been developed to identify system failures, applied to low-speed automated driving systems (Pods). The approach also helps identify test cases from simulation environments that need to be carried over to real-world testing.
Real, robust and comprehensive – smart simulation for AV validation
Laksh Parthasarathy Business head - automotive (autonomous validation) Tata Consultancy Services USA
To ensure the safety of AVs, it is said that a vehicle needs to be validated by driving over 11 billion miles. However, beyond the number of miles that need to be racked up, it’s the miles where the vehicle encounters incidents that matter. Physical testing is not economically viable – we have to consider simulations. Some challenges with simulation include identifying as many 'edge cases' as possible – where the software is likely to fail – along with creating an accurate representation of the world. In this paper, we explore unique techniques that could be leveraged to make simulations real, robust and comprehensive.
Physics-based simulation for ADAS and autonomous testing
Matt Daley Operations director rFpro UK
Physics-based simulation allows us to model and simulate the real world and the sensors that feed perception systems. Taking a physics-based approach to simulation ensures that the results are not just convincing for humans, but also for machine vision systems, which require far greater levels of fidelity to deliver behavior that correlates with real-world testing. rFpro will demonstrate the techniques being adopted on UK Government- and EU-funded projects in which it is collaborating, aimed at delivering a roadmap to regulatory approval for Level 4 and Level 5 autonomous vehicles.
Vehicle-in-the-loop: validation of automated driving functions with virtual elements
Uwe Gropengiesser Team manager active safety IAV GmbH GERMANY
Future automated driving functions are supporting ever greater parts of driving scenarios in increasingly complex situations. This calls for new approaches to safe and resource-conserving testing and validation. To extend the test process to cover complex and safety-critical systems, such as automated driving functions, IAV has developed an approach that combines a real-world test vehicle with virtual elements for reproducible, safe and resource-saving tests. This opens up possibilities for validating automated driving functions both in the early as well as in the late phases of the development process.
12:50 - 14:00
Workshop - dSPACE 14:00 - 16:00
Validating functions for autonomous driving
Get in, enter your destination, and the car will handle the rest completely autonomously. The driver can either be entertained by the infotainment systems or prepare for the next meeting on the way – this is the vision of autonomous driving. The way to this ideal is closely linked to the ability to validate functions for autonomous driving. To take into account the complex traffic situations and environmental influences in the validation process, all conceivable and unforeseeable situations must be simulated and incorporated into the development. This workshop focuses on tools that enable the validation of functions for autonomous driving throughout the entire development process. In addition to demonstrating how to generate simulation scenarios from real-world measurement data, this workshop will show how driving functions can be efficiently validated with various test methods (SIL, HIL, cloud computing) and suitable sensor environment models.
Simulation and Test Scenario Validation Cont... 16:00 - 18:05
Kirsty Lloyd-Jukes CEO Latent Logic UK
Certification of autonomous vehicles in synthetic environments: initial findings
Timothy Coley Product specialist XPI Simulation UK
XPI Simulation, Warwick University and Thales are undertaking a feasibility study to examine the certification of autonomous vehicles in synthetic environments. The research aims of this study include: identifying resolution, rate and type of data required to represent the virtual world with a view to informing standardization activities; understanding the security vulnerability of a synthetic system being used in this manner; and developing a certification approach that would achieve the expected repeatability and robustness within the synthetic environment to test autonomous vehicles. This presentation will cover initial findings from the research activity.
Development of model predictive motion planning and control for AD
The presentation will discuss generation of optimal trajectory for autonomous vehicles, advanced control guidance for autonomous vehicles, and real-time validation in virtual environments. The aim of the paper is to present a system that can generate a real-time online optimal feasible trajectory to maximize comfort, stability and travel efficiency of autonomous vehicles while overcoming their physical constraints. In order to validate and tune the algorithms, several dynamics maneuvers and realistic urban driving scenarios are simulated. In the second half of 2019 it is planned to test the algorithms on a driving simulator.
Iterative real drive simulation in HILS
Sreeraj Arole HiLS technical lead Tata Elxsi UK
Vehicle simulation in a lab environment has played a key role in development and testing in the automotive industry. However, even when actual vehicle parameters and closest real-world scenarios are incorporated in the lab environment, there are several situations where a real vehicle is needed for testing/calibrating/recalibrating vehicle functionalities. This paper presents an effective way of using the network log from a vehicle combined with external sensor simulation and plant model running on a high-precision, real-time simulator and control software in order to achieve a repeatable, robust simulation environment. This enables a drive cycle with multiple variations to be undertaken to assess performance and assist calibration.
Recently, autonomous driving development sped up due to the use of various simulation methods. However, there are few dedicated simulator tools for sensors that detect and measure objects. And most simulators don't faithfully reproduce actual radar, lidar and other sensors. COSMOsim solves this problem.
Millions of simulation scenarios with high-fidelity physics
Gilles Gallée Business development, autonomous vehicle simulation solutions Ansys FRANCE
This talk will provide insights into high-fidelity physics-based simulation methods used in autonomous vehicle driving scenario simulation as well as detailed component development. In particular, light simulation for optical sensors (camera, lidar) and electromagnetics simulation for radar will be discussed. Additionally, reduced order models (ROMs) and modeling methods will be presented. ROMs are used for expediting simulation beyond real time, while maintaining a high degree of physical accuracy. Finally, driving scenario simulation with physically accurate sensor models will be presented. Examples of typical corner cases that can only be addressed with high-fidelity physics-based simulation will be shown.
Day 3: Thursday, May 23
Robust Test, Verification and Validation Methodology 09:00 - 12:50
Paul Krutko President and CEO Ann Arbor Spark USA
Connected datalogging and analytics
Dr Marina Kreutz Data scientist FEV Europe GmbH GERMANY
Markus Kremer Data scientist FEV Europe GmbH GERMANY
The huge amount of data collected by loggers is a special challenge in the field of data analytics for autonomous driving scenarios. On one hand, the measured basic data is transmitted via network dataloggers. On the other hand, the amount of video data is too big to be transmitted via mobile connections. Since the vehicle data is generated in a proprietary unstructured raw format, an appropriate data and storage structure must be defined first. Particular attention is needed on interfaces between the loggers and the back end, realized by available streaming services. Another challenge is the processing of an enormous quantity of data to adequately prepare the raw data for further analysis.
Data acquisition and analysis for efficient testing and validation of ADAS/AD systems
Michael Luxen Technical specialist FEV Europe GmbH GERMANY
Highly and fully automated driver assistance systems place new demands on test and validation solutions. High-precision dataloggers are required to support these increasingly complex systems in the ADAS/AD area. The validation and optimization of automated driving functions requires time-synchronous and highly precise log data from vehicle sensors such as ultrasound, radar, lidar and video, and vehicle bus communication like CAN(-FD), FlexRay or Ethernet in real driving situations. This data can be used for playback, analysis, testing, simulation and validation. The big data process used (acquisition, preprocessing, handling and use cases) was developed and applied within the European-funded L3Pilot project. An outlook shows the further challenges for datalogger solutions.
Independent testing of automated vehicles as a component of AV certification
Dr David Hynd Chief scientist for engineering and technology TRL UK
TRL has been instrumental in designing many of the testing regimes that make European vehicles the safest in the world. It is now at the forefront of connected and autonomous vehicle testing, developing the safety case and providing the safety assurance for most of the technology demonstrations and operator trials happening in the UK. The speaker will present the methods being used and explain why a different approach to rigor is required for non-human-driven vehicles; how only a combination of a long history of research in this area coupled with a clear vision into the future is required to understand their interactions with and impact on their human-driven counterparts.
Parking cars autonomously
Dr Brian Holt Head of autonomous driving and parking Parkopedia Limited UK
Autonomous Valet Parking (avp-project.uk) is a two-and-a-half-year InnovateUK-funded project to develop maps suitable to support navigation and localization within GNSS-denied environments. A specific goal is to demonstrate and test these maps on an autonomous vehicle for which we are using Autoware on a StreetDroneONE. This presentation will discuss the software architecture, simulation and practical details of controlling the vehicle safely.
10:40 - 11:10
Reliable lane-keeping and platooning for automated road transport
Surya Satyavolu Founder and CTO Sirab Technologies Inc USA
Lane-keeping and platooning are fundamental functionalities necessary to achieve safe, scalable and high-capacity automated road transport. Although rudimentary lane-keeping is demonstrated using currently available painted lane guides, reliability at a functional level as well as dependability and safety assurance are impossible with that kind of approach. Similarly, although platooning has been researched, reliability is a key performance metric necessary for safety assurance in addition to system-level objectives like operational efficiency and scalable capacity. We present our unique architecture for reliable platooning and lane-keeping based on radar, IMU and wireless communications meeting system-level objectives.
Create unknown complex test cases for indeterministic autonomous vehicle behaviors
Fabrice Trollet Product owner in model-based testing All4tec FRANCE
Dr Francine Jeremie Innovation project manager Renault FRANCE
This presentation gives a solution to automatically create and execute complex and unknown test cases to validate indeterministic autonomous vehicle behaviors, compliant with SOTIF §11, with a high rate of variability. A real-time closed loop is used with a 3D simulator tool and a model-based testing tool. At each step of the simulation, the 3D environment of the autonomous vehicle is controlled by a model that analyzes all the different behavior possibilities for next steps, and chooses one of them depending on probability. The test case is created during the simulation and is adapted in real time.
Automated long-term validating of cloud-based driver assistance functions
Uwe Gropengiesser Team manager active safety IAV GmbH GERMANY
Modern cloud-based driver assistance functions are used to increase safety on the streets and will be a necessary part of future developments in autonomous driving. Developing these kinds of functions requires testing and validating the function at any development state and beyond. To provide long-lasting reliability even between different vehicle types and software statuses, a long-term approach for testing cloud-based driver assistance functions is needed. As a possible solution, virtual instances of hardware modules simulate vehicle behavior and can be automatically tested over a long time. This ensures durable functional reliability even for hybrid software states.
Functional testing of autonomous vehicle decision module
Adel Djoudi Research engineer IRT SystemX FRANCE
Motion planning is a major component of any autonomous driving system. The safety assessment of such components requires a formal characterization of the perception and decision mechanisms. In this context, we consider a decision module as a black box and try to determine the 'right decision', if it exists. An optimization-based oracle is created for each control function. The oracle allows each scene in the environment to be linked to the desired decision regardless of the black box. The black box and the oracle are run on several critical functional scenarios. In output, a report on decision making is provided.
12:50 - 14:00
Lunch and conference close
Open Road & Real World Testing 09:00 - 12:00
Dr Igor Doric Executive director Messring Active Safety GmbH GERMANY
Integration of the StreetWise scenario database in AVL virtual testing tools
Hannes Schneider Senior software engineer AVL List GmbH AUSTRIA
Recently, the StreetWise scenario database has become available within the AVL toolchain. This data-driven cloud-based scenario database provides insight in real-world scenario classes, their exposure and variation. Seamless integration with the AVL test planning tool allows test engineers to select scenario classes and parameter ranges and define their test plans with real-world percentiles of observed scenarios. Test cases are expressed in OpenDRIVE and OpenSCENARIO and can be run through Model.CONNECT and Vires VTD. Through StreetWise real-world statistics and AVL test management tooling, the question of "have we tested enough?" can be addressed for validation of automated driving.
Catalonia Living Lab – CAV testing on public roads
Stefan de Vries Project manager Applus IDIADA SPAIN
Since its launch, Catalonia Living Lab has steadily expanded its abilities related to development and testing of connected and automated vehicles (CAV). In order to understand clients’ needs related to CAV testing on public roads, pre-studies, market research and interviews with 30 potential clients were conducted, resulting in the definition of 12 universally applicable objectives. These objectives guide the current deployment of CAV testing services on Catalan public roads, as well as similar initiatives undertaken by international partners. If you are interested in CAV testing on public roads or the development of CAV testbeds, this is your topic.
Successful methods for open-road autonomous vehicle validation
Dr Wolfgang Nickel Senior manager DTC GmbH Navigation & Security Solutions GERMANY
Autonomous vehicle engineers need robust and repeatable methods to validate vehicle performance on the open road in real time. This presentation will share how ground truth data from an inertial navigation system provides a reference for vehicle position, orientation and dynamics that is needed in difficult urban test areas. We will share a number of current examples where this technology is being used effectively by automotive manufacturers and sensor suppliers.
Open-site trialling of automated vehicles at the Swiss Transit Lab
Dominique Müller Managing director AMoTech GmbH SWITZERLAND
Conveniently located near Zurich Airport, the Swiss Transit Lab incorporates automated vehicles into the local public transport system. For the population, this means involvement in the development and trialling of various first/last-mile services. For vehicle manufacturers and component suppliers, this means early field validation of new technology. Fast project execution thanks to short paths in one of the smallest Swiss cantons, and excellent cooperation with the relevant authorities at all levels, are the trademark of the Swiss Transit Lab, which is run jointly by Public Transport of Schaffhausen and AMoTech.
10:40 - 11:10
EasyMile's way to safe autonomous driving
Dr Olivier Lefebvre Product manager EasyMile FRANCE
EasyMile is developing an autonomous driving solution that is currently running on more than 70 operational shuttles worldwide and is being integrated on other types of vehicles for people or goods transportation. In this talk we will present the key points of EasyMile’s navigation solution, and also provide insights into the company's approach to the development of a product that constantly remains operational and safe and that is also continuously evolving to solve new transportation use cases.
MUEAVI: the future autonomous vehicle validation infrastructure for smart city
Luca Zanotti Fragonara Lecturer in structural dynamics Cranfield University UK
Validation of driving model, human factor model and traffic model is key for the future of the autonomous vehicle industry. Most previous infrastructures have mainly focused on validating those models separately either in a physical or virtualized infrastructure. However, the physical infrastructure cannot cover all the possible scenarios, nor can the virtualized infrastructure easily accommodate a realistic driving model. To achieve comprehensive validation in smart city, the Multi-User Environment for Autonomous Vehicle Innovation (MUEAVI) has been built. With reference to multiple research projects, the latest research solutions for autonomous vehicle validation are presented.
Test and Validation of LiDAR, Sensors & Mapping Technology 12:00 - 16:00
Dr Igor Doric Executive director Messring Active Safety GmbH GERMANY
Sensor simulation plug-in for radar, lidar, ultrasound and camera
Dr Johannes Meyer Lead engineer computer vision ITK Engineering GmbH GERMANY
About 40 unique sensors are required for environment and situation recognition in highly automated driving. This enables high-level simulations for virtual sensor systems, automated selection and optimization of relevant scenarios. ITK Engineering has developed the raytracing framework to enhance complex environment and vehicle simulations. This co-simulation uses custom rendering engines from the visual effects industry and provides whitebox interfaces for sensor models and raw data generation – independent from manufacturer. Parallelization and GPU computing optimize cycle times for real-time, closed-loop simulation including multi-sensor systems. This enables consistency of tests and scenarios across development phases, and harmonizes models across toolchain boundaries.
Frequency domain automotive radar verification: enabler of autonomous driving deployment
Dr Kasra Haghighi CEO UniqueSec SWEDEN
Radar sensors play a safety-critical role in autonomous driving (AD) and advanced driver assistance systems (ADAS). Thus their reliable functioning needs to be verified by smarter, less risky and more efficient methods than millions of kilometers of test driving. The radar target simulator (RTS) enables evaluation of radar sensors, ADAS and AD for their performance, availability and reliability on a stationary car. RTS sits in front of the vehicle radar inside the lab and creates the illusion of any test scenario, even dangerous and improbable scenarios, for the radar by emulating electromagnetic emissions analogous to real radar reflections.
12:50 - 13:50
Millimeter-wave distributed radar modules for autonomous driving
Mitsuru Kirita Manager Mitsubishi Electric Corporation JAPAN
Various sensors for automobiles are studied and developed actively to realize autonomous driving. For autonomous driving, the sensors must reliably detect road structures, vehicles and pedestrians. The front sensor must be able to separate multiple targets at long distances with high resolution in azimuth and elevation. We have been developing TRX modules for millimeter-wave radar for autonomous driving, and propose a technique to realize high-resolution angle measurement performance with the virtual antenna aperture by distributing multiple TRX modules. In this presentation we will show this new technology and the field test results.
Physics-based lidar simulation
Jordan Gorrochotegui Senior technical product manager Siemens NETHERLANDS
Reaching level SAE autonomy is a big challenge that the automotive industry as a whole is trying to address. To be successful, simulation will need to play a key role as part of a robust and agile V-cycle. In this presentation we focus on lidar systems, and the importance of having physics-based lidar simulation to help develop robust and safe ADAS systems and autonomous driving capabilities. Simulation can help sensor manufacturers develop the next generation of sensors for AV vehicles, and it can also help OEMs make sure that their AV systems are robust, safe and reliable.
Autonomous vehicle navigation using single map in non-snow and snowstorm conditions
Dr Umar Zakir Abdul Hamid Senior autonomous vehicle engineer Sensible 4 FINLAND
Sensible 4's autonomous driving technology provides a solution to extreme weather conditions. In this work, the algorithm was tested in the Arctic Circle in a prototype vehicle, Juto, where it navigated autonomously in non-snow and snowstorm conditions using the same map. In both scenarios, our system provides desirable autonomous navigation, thus rendering a solution to the extreme weather issue. The system can also be utilized for use in other bad weather conditions, where robust algorithms are required to aid the autonomous vehicle perception and mapping modules. Thus, it promises an all-weather AD experience.
SceneScan: real-time stereo vision for fast 3D sensing
Dr Konstantin Schauwecker CEO Nerian Vision GmbH GERMANY
Autonomous vehicles must be able to sense their 3D environment. Today, lidars are widely used for this task. However, the low vertical resolution, low frame rate and high costs have motivated the development of alternative sensors. Stereo vision is a promising technology that can provide dense outdoor measurements. The image processing is, however, very computationally demanding. This is why Nerian developed an FPGA-based stereo image processor: SceneScan. With SceneScan it is possible to sense depth data at 100 fps, or 30 million 3D points per second. At the same time, the system is small and low power, making it ideal for vehicle integration.
A new ultrasonic sensor for pedestrian detection
Dr Peter Nauth Professor Frankfurt University of Applied Sciences GERMANY
The presentation discusses a new approach for pedestrian detection by means of a sophisticated analysis of ultrasonic signals. The main objective is to enable driver assistance systems in vehicles to recognize whether an obstacle in front is a pedestrian or a car. The sensor evaluates ultrasonic signals backscattered from the obstacle and extracts task-specific features that are used to differentiate between pedestrians and cars.
Please Note: This conference program may be subject to change