UL 4600 FAQ *
Eventually. The draft standard will be reviewed by the standard technical panel (STP) as part of the preliminary review. It will likely go through several iterations before moving on to the formal balloting and public review process. However, we encourage any interested stakeholders to apply to join the STP to make sure their voices are heard. While the STP will be limited due to size and balance, those who are not appointed to the STP will be formally added as stakeholders.
Scoping and writing the standard began in 2018. The goal is to have a completed standard published by the end of 2019 or early 2020. If the time frame to create this standard seems fast, that is one of the benefits of the UL standards development process. The UL standard development process uses a small drafting committee to create the first draft version of the standard. That drafting committee includes UL standards experts and a small number of subject matter experts. Once that first draft standard is completed, a group of diverse industry stakeholders and a broader group of subject matter experts will be recruited to review and provide feedback on the draft standard. This group, the Standards Technical Panel (STP), is a consensus voting committee and is being formed in Spring 2019. The STP will begin the first review upon the completion of the first draft standard. Once the approved standard is published, it will be under continuous maintenance, meaning that we expect periodic updates to keep up with technological advances as often as every six months.
The proposed UL 4600 standard is the first comprehensive safety standard for autonomous products. UL 4600 will address safety principles and processes for the evaluation of autonomous products. The standard will address the ability of autonomous products to perform their intended function without human intervention, based on their current state and sensing of their operating environment. Other safety aspects of the autonomous will also be addressed. The Standard will encompass fully autonomous systems that move, such as self-driving cars; vehicles for mining, agriculture, and maintenance; and lightweight unmanned aerial vehicles. The first version will be specific to autonomous self-driving cars that do not depend upon humans to perform or supervise driving (e.g., SAE Level 4). It is envisioned that future end product standards will tailor UL 4600 to address specialized applications such as warehouse robots.
No. This standard is focused on building a safety case for the deployment of SAE Level 4/5 vehicles, not for practices related to on-road testing. The practices involved are sufficiently different that a separate standard is required for on-road testing safety.
What is the relationship between UL 4600 and other standards such as ISO 26262 and ISO 21448-SOTIF?
The proposed UL 4600 standard focuses on ensuring that a comprehensive safety case is in place, including safety claims, argumentation, and evidence. It is intended to cover computer-based system aspects of autonomous operation. It is specifically designed to build upon the strengths of existing standards such as ISO 26262, and evolving standards such as ISO 21448-SOTIF. It is not a competing standard to those and other standards being developed. UL 4600 permits claiming appropriate credit for conforming to those standards while ensuring autonomy-specific gaps are filled.
Areas of specific emphasis include safety practices for machine learning-based approaches, functionality for which complete requirements are not available, addressing “unknown unknowns” in safety argumentation, and ensuring that adequate fault mitigation capabilities are present in systems that do not have oversight by human drivers. We anticipate that many users of the standard will, in fact, build upon existing ISO 26262 and newly created ISO 21448-SOTIF conformance strategies, and we believe these standards complement UL 4600.
The standard requires that the designers clearly define the Operational Design Domain (ODD) in which they plan to operate. They must then show that they have handled all the hazards relevant to that ODD (as well as other issues, such as what happens when the system exits the ODD). Therefore, the standard permits each design team to solve only the problems that they need to solve to ensure safety for their specific system.
The bulk of the standard is concerned with ensuring that safety cases include all relevant considerations for deploying a fully autonomous vehicle (e.g., SAE Level 4). This means the standard does not tell anyone how to build a vehicle. Rather, it makes sure that safety has been considered in a comprehensive way during the design and test of the vehicle. As a simple example, it does not require the use of a certain number and type of cameras, lidars, and radars. Rather, it requires that the designer show that whatever sensors have been used provide a sufficient, robust ability to detect and classify all objects relevant to the system’s intended operational design domain. We further expect that a fast update cycle (less than a year, if need be) will permit the standard to evolve quickly as required to keep up with emerging technical challenges.
The STP is the voting committee that determines the final content of the initial standard and maintains the revision process. The STP application period for UL 4600 ends on April 22nd. Stakeholders who are not members of the STP can apply to receive and comment upon draft versions as non-voting members after that date. Requests for application to STP membership and stakeholder group membership should be sent to: Deb Prince at UL at <Deborah.Prince@ul.com>
Edge Case Research was formed by leading autonomy and software safety experts from Carnegie Mellon University who believe that safety should be built into all software products from the ground up. The co-founders of ECR have been involved with autonomous vehicle safety for almost as long as autonomous vehicle development has been going on. Over the past several years, our team has been working on and helping to define best practices in autonomous vehicle and robotic safety for numerous clients and partners.
If I am not on the STP, and have questions on UL 4600, who should I contact?
For questions from individuals or organizations outside the STP, please email Deborah Prince at UL at Deborah.email@example.com
*Disclaimer – All statements concerning the draft standard are subject based on the feedback from the Standard Technical Panel (STP).