This one day workshop will bring together researchers working on a range of techniques for formal verification of autonomous systems, to present recent work in the area, discuss key difficulties, and stimulate collaboration between the robotics and formal methods communities. This workshop will include invited speakers, contributed papers, and experience reports.
FMAS 2020 will be held online, due to the ongoing disruption caused by COVID-19. Since many of the conferences that we were looking to for hosting the workshop are not accepting satellite events, FMAS 2020 will run stand-alone.
Autonomous – and Robotic – Systems present unique challenges for formal methods. They are embodied entities that can interact with the real world and make autonomous decisions. Amongst others, they can be viewed as safety-critical, cyber-physical, hybrid, and real-time systems. Key issues for formal methods applied to autonomous systems include capturing how the system will deal with a dynamic external environment and verification of the system’s decision making capabilities – including planning, ethical, and reconfiguration choices. Some autonomous systems require certification before deployment, others require public trust for wide adoption; both of these scenarios are being tackled by formal methods.
The goals of this workshop are to bring together leading researchers in this area to present recent and ongoing work, including experience reports and case studies as well as identify future directions for this emerging application of formal methods. This workshop is concerned with the use of formal methods to specify, model, or verify autonomous or robotic systems; in whole or in part. Submissions may focus on case studies that identify the challenges for formal methods in this area, or experience reports that provide guidelines for tackling these challenges.
We are especially interested in work using integrated formal methods, discussing the future directions of the field, using Runtime Verification or other approaches to deal with the reality gap, the cross over of safety and security, and verification of systems against safety assurance arguments or standards documents.
(All times are GMT)
- 12.50 - 13.00: Introduction
- 13.00 - 14.00: Invited Talk: Runtime Verification with Copilot 3 (Ivan Perez)
- 14.00 - 14.15: BREAK
- 14.15 - 14.45: YAP: Tool Support for Deriving Safety Controllers from Hazard Analysis and Risk Assessments (Mario Gleirscher)
- 14.45 - 15.15: A Formal Model for Quality-Driven Decision Making in Self-Adaptive Systems (Fatma Kachi, Chafia Bouanaka and Souheir Merkouche)
- 15.15 - 15.45: Towards Compositional Verification for Modular Robotic Systems (Rafael C. Cardoso, Louise A. Dennis, Marie Farrell, Michael Fisher and Matt Luckcuck)
- 15.45 - 16.00: BREAK
- 16.00 - 17.00: Invited Talk: Verifying Machine Ethics (Louise A. Dennis)
- 17.00 - 17.15: BREAK
- 17.15 - 17.45: How to Formally Model Human in Collaborative Robotics (Mehrnoosh Askarpour)
- 17.45 - 18.15: From Requirements to Autonomous Flight: An Overview of the Monitoring ICAROUS Project (Aaron Dutle, Cesar Munoz, Esther Conrad, Alwyn Goodloe, Laura Titolo, Ivan Perez, Swee Balachandran, Dimitra Giannakopoulou, Anastasia Mavridou and Thomas Pressburger)
- 18.15 - 18.30: Closing
11th of September 2020 25th of September 2020 (AOE)
23rd of October 2020 26th of October 2020
- Final Version due:
6th of November 2020 13th of November 2020
- Workshop: 7th of December 2020 (Online)
This year, FMAS will be held online via a video conference system. We will circulate details closer to the event, when the number of attendees is clearer.
You can register to attend FMAS2020, for free, using our eventbrite page.
The proceedings for FMAS2020 are available online via EPTCS. We would like to thank our editor and the rest of the team at EPTCS for their help with publishing these proceedings.
We had two invited speakers for FMAS 2020.
- Ivan Perez is a research scientist at the National Institute of Aerospace, and has been a member of the NASA Formal Methods Group since 2018. As a contractor assigned to NASA Langley Research Center, he investigates the application of formal methods to problems in aerospace, with particular focus on runtime verification of unmanned aerial vehicles. In the past, Dr. Perez also worked as a programmer and researcher for the High Performance Computing Center (Germany), IMDEA Software (Spain), the Technical University of Madrid (Spain), and the University of Twente (Netherlands), as well as for multiple functional programming companies. Dr. Perez completed his PhD in Computer Science at the University of Nottingham (UK), which focused on testing and functional programming applied to games and user interfaces. He also holds a Master’s Degree in Computational Logic and a Degree of Engineer in Computer Science, both from the Technical University of Madrid.
- Title : Runtime Verification with Copilot 3
- Abstract: Ultra-critical systems require high-level assurance, which cannot always be guaranteed in compile time. The use of runtime verification (RV) enables monitoring these systems in runtime, to detect property violations early and limit their potential consequences. However, the introduction of monitors in ultra-critical systems poses a challenge, as failures and delays in the RV subsystem could affect other subsystems and threaten the mission as a whole. In this talk we present Copilot 3, a runtime verification framework for real-time embedded systems. Copilot monitors are written in a compositional, stream-based language with support for a variety of Temporal Logics (TL), which results in robust, high-level specifications that are easier to understand than low-level imperative implementations. The framework then translates monitor specifications into C code with static memory requirements, which can be compiled to run on embedded hardware. We also discuss how Copilot has been used in experimental research by NIA, NASA and other organizations, its place in relation to other RV frameworks, and possible future directions for RV in autonomous systems.
- Louise Dennis is from the University of Manchester. Her background is in artificial intelligence and more specifically in agent and autonomous systems and automated reasoning. She has worked on the development of several automated reasoning and theorem proving tools, most notably the Agent JPF model checker for BDI agent languages; the lambda-clam proof planning system; and the PROSPER Toolkit for integrating an interactive theorem prover (HOL) with automated reasoning tools (such as SAT solvers) and Case/CAD tools. More recently she has investigated rational agent programming languages and architectures for autonomous systems, with a particular emphasis on verifiable systems and ethical reasoning.
- Title : Verifying Machine Ethics
- Abstract: Machine ethics is concerned with the challenge of constructing ethical and ethically behaving artificial agents and systems. One important theme within machine ethics concerns explicitly ethical agents – those which are not ethical simply because they are constrained by their programming or deployment to be so but which use a concept of ethics in some way as part of their operation. Normally this requires the provision of rules, utilities or priorities by a programmer, knowledge engineer or user. In this talk I will address the question of how such explicitly ethical programs can be verified. What kind of properties can we consider and what kind of errors might we find?
We accepted the following papers for FMAS 2020.
- How to Formally Model Human in Collaborative Robotics
- Authors: Mehrnoosh Askarpour
- Abstract: Human-robot collaboration (HRC) is an emerging trend of robotics that promotes the co-presence and cooperation of humans and robots in common workspaces. Physical vicinity and interaction between humans and robots, combined with the uncertainty of human behavior, could lead to undesired situations where humans are injured. Thus, safety is a primary priority for HRC applications. Safety analysis via formal modeling and verification techniques could considerably avoid dangerous consequences, but only if the models of HRC systems are comprehensive and good enough, which requires reasonably realistic models of human behavior. This paper explores state-of-the-art solutions for modeling human and discusses which ones are suitable for HRC scenarios.
- Towards Compositional Verification for Modular Robotic Systems
- Authors: Rafael C. Cardoso , Louise A. Dennis , Marie Farrell, Michael Fisher, and Matt Luckcuck
- Abstract: Software engineering of modular robotic systems is a challenging task, however, verifying that the developed components all behave as they should individually and as a whole presents its own unique set of challenges. In particular, distinct components in a modular robotic system often require different verification techniques to ensure that they behave as expected. Ensuring whole system consistency when individual components are verified using a variety of techniques and formalisms is difficult. This paper discusses how to use compositional verification to integrate the various verification techniques that are applied to modular robotic software, using a First-Order Logic (FOL) contract that captures each component's assumptions and guarantees. These contracts can then be used to guide the verification of the individual components, be it by testing or the use of a formal method. In this paper, we provide an example of the former using an illustrative example of an autonomous robot used in remote inspection. We also discuss a way of defining a confidence metric for the verification associated with each component.
- From Requirements to Autonomous Flight: An Overview of the Monitoring ICAROUS Project
- Authors: Aaron Dutle, Cesar Munoz, Esther Conrad, Alwyn Goodloe, Laura Titolo, Ivan Perez, Swee Balachandran, Dimitra Giannakopoulou, Anastasia Mavridou and Thomas Pressburger
- Abstract: The Independent Configurable Architecture for Reliable Operations of Unmanned Systems (ICAROUS) is a software architecture incorporating a set of algorithms to enable autonomous operations of unmanned aircraft applications. This paper provides an overview of Monitoring ICAROUS, a project whose objective is to provide a formal approach to generating runtime monitors for autonomous systems from requirements written in a structured natural language. This approach integrates FRET, a formal requirement elicitation and authoring tool, and Copilot, a runtime verification framework. FRET is used to specify formal requirements in structured natural language. These requirements are translated into temporal logic formulae. Copilot is then used to generate executable runtime monitors from these temporal logic specifications. The generated monitors are directly integrated into ICAROUS to perform runtime verification during flight.
- YAP: Tool Support for Deriving Safety Controllers from Hazard Analysis and Risk Assessments
- Authors: Mario Gleirscher
- Abstract: This tool paper provides a brief overview of YAP, a research tool for risk modelling and discrete-event safety controller design. For an example from the collaborative robotics domain, it is illustrated how one can use YAP in combination with the stochastic model checker PRISM to derive, verify, and synthesise controllers responsible for switching between activities and safety modes.
- A Formal Model for Quality-Driven Decision Making in Self-Adaptive Systems
- Authors: Fatma Kachi, Chafia Bouanaka, and Souheir Merkouche
- Abstract: Maintaining an acceptable level of quality of service in modern complex systems is challenging and particularly in presence of various forms of uncertainty caused by changing execution context, unpredicted events, etc. Self-adaptability is a well-established approach for modelling such systems, and thus enabling them to achieve functional and/or quality of service objectives by autonomously modifying their behavior at runtime. Guarantying a continuous satisfaction of quality objectives needs a rigorous definition and analysis of system behavioral properties. Formal methods constitute a promising and effective solution in this direction in order to rigorously specify mathematical models of a software system in general and analyze its behavior in particular. They are also largely adopted to analyze and provide guarantees on the required properties of self-adaptive systems. Therefore, we introduce in the present work a formal model for quality-driven self-adaptive systems under uncertainty. We combine high-level Petri nets and plausible Petri nets in order to model complex data structures enabling system quality attributes quantification and to improve the decision-making process through selecting the most plausible plans with regard to the system actual context.
Topics of interest include (but are not limited to):
- Experience reports/case studies on applying formal methods to autonomous and/or robotic systems,
- Novel formal methods that can be applied to autonomous and/or robotic systems,
- The modification of existing formal methods to suit autonomous and/or robotic systems, and
- Future directions for formal methods for autonomous and/or robotic systems.
There are two categories of submission:
- Short papers – 6 pages, suitable for overviews of an approach or work-in-progress. Work from PhD students is particularly welcome;
- Long papers – 15 pages, suitable for descriptions of completed studies, new approaches, or new directions.
Submission will be via easychair. Submissions must be prepared using the EPTCS LaTeX style. Please note that the page limits above exclude references.
Each submission will receive at least three, single-blind reviews. If a paper is accepted, at least one of the authors must attend the workshop to present their work. Accepted papers will be published via EPTCS.
- Christopher Bischopink, University of Oldenburg (Germany)
- Rafael C. Cardoso, University of Manchester (UK)
- Angelo Ferrando, University of Manchester (UK)
- Mallory S. Graydon, NASA (USA)
- Jérémie Guiochet, University of Toulouse (France)
- Rob Hierons, University of Sheffield (UK)
- Taylor T. Johnson, Vanderbilt University (USA)
- Bruno Lacerda, Oxford University (UK)
- Raluca Lefticaru, University of Bradford (UK)
- Sven Linker, Lancaster University Leipzig (Germany)
- Anastasia Mavridou, SGT Inc./NASA Ames Research Center (USA)
- Claudio Menghi, University of Luxembourg (Luxembourg)
- Dominique Méry, Université de Lorraine, LORIA (France)
- Alice Miller, University of Glasgow (UK)
- Alvaro Miyazawa, University of York (UK)
- Rosemary Monahan, Maynooth University (Ireland)
- Ivan Perez, NIA/NASA Langley Research Center (USA)
- Maike Schwammberger, University of Oldenburg (Germany)
- Silvia Lizeth Tapia Tarifa, University of Oslo (Norway)
- Laura Titolo, National Institute of Aerospace (USA)
- Hao Wu, Maynooth University (Ireland)