Learning for Safety-Critical Control with Control Barrier Functions

2019·Arxiv

Abstract

Abstract

Modern nonlinear control theory seeks to endow systems with properties of stability and safety, and have been deployed successfully in multiple domains. Despite this success, model uncertainty remains a significant challenge in synthesizing safe controllers, leading to degradation in the properties provided by the controllers. This paper develops a machine learning framework utilizing Control Barrier Functions (CBFs) to reduce model uncertainty as it impact the safe behavior of a system. This approach iteratively collects data and updates a controller, ultimately achieving safe behavior. We validate this method in simulation and experimentally on a Segway platform.

1. Introduction

Safety is of significant importance in many modern control applications, and as the complexity of systems increases, it is necessary to rigorously encode safety properties during the controller design process. Autonomous driving, industrial robotics, and aerospace vehicles are examples of rapidly growing applications where safe control synthesis is critical. In practice, the models used to design such controllers are imperfect, with model uncertainty arising due to parametric error and unmodeled dynamics. This uncertainty can lead to unsafe or dangerous behavior, and thus it is critical to quantify safety in the face of uncertainty.

In this work we consider a data-driven, machine learning approach to reduce model uncertainty and improve the safe behavior of a system. Learning-based approaches have already shown great promise for controlling systems with uncertain models (Schaal and Atkeson (2010); Kober et al. (2013); Khansari-Zadeh and Billard (2014); Chowdhary et al. (2015); Cheng et al. (2019); Taylor et al. (2019b); Shi et al. (2019); Fan et al. (2019)). We look to achieve safety defined in terms of set invariance (Blanchini (1999); Ames et al. (2019)), which is an area of active research at the intersection of machine learning and control theory (Berkenkamp et al. (2016b); Fisac et al. (2018)). Additional details on related work are provided in Section 6.

We will leverage Control Barrier Functions (CBFs) for synthesizing safe controllers (Ames et al. (2014, 2017)). CBFs have become increasingly popular for enforcing safety (Nguyen and Sreenath (2016); Wang et al. (2018)), but their safety guarantees require an accurate model of the system, and

thus model uncertainty can lead to degradation of these guarantees (Kolathaya and Ames (2018)). Robust CBF formulations can ensure safety in the face of model uncertainty (Gurriet et al. (2018); Xu et al. (2015)), but may be overly restrictive of the system’s behavior. Adaptive CBF methods can provide safety with arbitrarily large parametric error (Taylor and Ames (2019)), but only over a restricted class of model uncertainty.

One challenge in utilizing learning for improving controllers is collecting training data that accurately reflects the desired learning environment. Exhaustive data collection suffers from the curse of dimensionality and scales poorly with the size of the system’s state and input. Additionally, the pre-collection of data upfront can lead to bad performance as the learning-augmented controller may enter new states not present in the pre-collected training data. We will utilize episodic learning approaches such as Datset Aggregation (DAgger) (Ross et al. (2010)) to address these challenges efficiently, and lead to an iteratively improved controller. Furthermore, we build upon recent work utilizing learning in the context of Control Lyapunov Functions (CLFs) (Taylor et al. (2019b)) to construct an approach for learning model uncertainty. Unlike this preceding work, our method learns model uncertainty impacting safety rather than stability, and provides experimental demonstration.

Our contribution: The contribution of this work is a novel approach for learning model uncertainty directly as it impacts the evolution of a Control Barrier Function and synthesizing a new controller for enforcing safety. Previous work has focused on learning an invariant set under a given controller, or learning unmodeled dynamics in the full-order state dynamics and modifying a controller. This approach learns the effect of unmodeled dynamics and parametric error on the system’s behavior episodically, and integrates with optimization based methods for enforcing safety from nonlinear control theory. We demonstrate the functionality of this learning approach for a Segway system both in simulation and, for the first time, experimentally on a hardware platform.

Our paper is organized as follows. Section 2 provides a review of Control Barrier Functions and safety-critical control. In Section 3 we state assumptions on our model uncertainty, and define our learning approach for capturing the impact of this uncertainty on the CBF dynamics. Next, Section 4 details issues with standard supervised learning in a sequential prediction task, and provides an episodic framework that utilizes our particular learning approach. Lastly, Section 5 provides both simulation and experimental results on a Segway platform.

2. Control Barrier Functions

In this section we provide a review of Control Barrier Functions (CBFs) and how they can be utilized to ensure the safety of a system. This will motivate a particular episodic learning approach that achieves safety in the presence of uncertainty in modeled system dynamics.

Consider a dynamic system with state and control input . We assume that the dynamics of the system are continuous in time and affine in the control input, such that:

where is a locally Lipschitz continuous controller that yields closed-loop dynamics. Here are assumed to be locally Lipschitz continuous and, therefore, is locally Lipschitz continuous. Under this assumption, for any initial state there exists a time interval of existence, , such that there is a unique solution, , satisfying (1) with

The notion of safety is formalized by specifying a safe set that the state of the system must remain in to be considered safe. In particular, consider a set defined as the 0-superlevel set of a continuously differentiable function a regular value of h, yielding:

We refer to S as the safe set, and note that . This motivates the following definitions of forward invariance and safety:

Definition 1 (Invariance & Safety) A set S is forward invariant if for every all . The system (1) is safe with respect to the set S if the set S is forward invariant.

This definition implies that a system remains safe under a particular control policy only if all solutions to (1) that begin in the safe set remain in the safe set.

Control Barrier Functions serve as a synthesis tools for attaining the forward invariance, and thus safety, of a set (Ames et al. (2014); Xu et al. (2015)). Before defining CBFs, we note that a continuous function extended class K function (strictly monotonically increasing. If then is said to be an extended class function (. This enables the following definition of Control Barrier Functions:

Definition 2 (Control Barrier Function (CBF), Ames et al. (2017)) Let be the 0-superlevel set of a continuously differentiable function a regular value. h is a control barrier function (CBF) for (1) on S if there exists such that for all

Given a CBF h for (1) and a corresponding , we can consider the point-wise set of all control values that satisfy (3):

One of the main results of (Ames et al. (2014); Xu et al. (2015)) is that the existence of a CBF for S implies the system (1) can be rendered safe with respect to S:

Theorem 3 Given a set defined as the 0-superlevel set of a continuously differentiable function is a CBF for (1) on S, then any Lipshitz continuous controller , such that , renders the system (1) safe with respect to the set S.

This result motivates the construction of a point-wise optimal controller seeking to minimize a cost associated with the choice of input. To this end, we consider the safety-critical control formulation (Gurriet et al. (2018)) that seeks to filter a hand-designed but potentially unsafe Lipschitz continuous controller, , to find the nearest safe action:

The validity of h as a CBF ensures the feasibility of this optimization problem, and the resulting controller is Lipschitz continuous (Morris et al. (2013); Jankovic (2018)). As the dynamics model (1) appears in the constraint enforcing safety, the guarantees of safe control synthesis endowed by this controller require strong assumptions on the accuracy of the dynamics model.

3. Uncertainty Models & Learning

This section provides structural assumptions on the model uncertainty present in our system, and defines our dynamics learning problem in the context of safety. In practice, uncertainty in the dynamics of the system exists due to parametric error and unmodeled dynamics, such that the functions f and g are not precisely known. Rather, control synthesis is done with a nominal model that estimates the true dynamics of the system:

where are Lipschitz continuous. By adding and subtracting this expression to (1), we see that the system evolves under the differential equation given by:

where are the unmodeled dynamics. This uncertainty in the dynamics additionally manifests in the time of derivative of CBFs designed for the system:

where . The presence of uncertainty in the CBF time derivative makes it impossible to verify if a given control input satisfies the inequality in (3), and can lead to unsafe behavior. One critical assumption we make on the uncertainty in the dynamics is as follows:

Assumption 1 If a function h is a valid CBF for the nominal model of the system (4), then it is a valid CBF for the uncertain dynamic system (5). Mathematically this assumption appears as:

Intuitively this assumption requires that a set within the state space that can be keep safe for the nominal model of the system can also be kept safe for the uncertain system. Technically this assumption amounts to an assumption that the relative degree of h for the model is the same as the relative degree of h for the true system. This assumption on the true system naturally follows if the true system retains the same actuation capability as the model, with more technical details provided in Sastry (1999). While this assumption may enable a robust CBF approach for certifying safety, this method may be overly conservative. Instead, we take a data-driven approach similar to (Taylor et al. (2019b)) to learn uncertainty as it appears in the time derivative of the CBF, , given in (6).

To motivate our learning framework, consider a simple approach for learning a and b via supervised regression (Gy¨orfi et al. (2006)): an experiment is conducted using a nominal controller to collect data and learn functions that approximate a and b via supervised regression. More concretely, an experiment consists of sampling an initial state for the system from an initial state distribution , and allowing the system to evolve for a finite time interval under a given state-feedback controller (using a sample-hold implementation). This yields a discrete time state and input history, allowing the computation of a discrete time history of the CBF h. This time history is numerically differentiated to compute an approximate time history of the true value of the time derivative yielding a data-set of input-output pairs:

Consider two nonlinear function classes , we define the estimator:

and let H be the class of all such estimators mapping . Specifying a loss function , the supervised regression task is to find an estimator in H via empirical risk minimization (ERM):

This experimental framework can be utilized in both simulation (learning estimates of the CBF dynamics when model information is withheld from the state-feedback controller), or directly on hardware platforms (when a given model does not accurately describe the physical system).

4. Episodic Learning Framework

In this section we discuss the consequences of using conventional supervised learning in this context, and formulate an episodic learning framework to overcome these consequences. A critical assumption of supervised learning is independently and identically distributed (i.i.d) training data. The data collected via the preceding experimental framework violates this assumption, as each data point (state and input pair) depends on the value of preceding data points. One potential consequence of violating this assumption when using standard supervising learning is error cascades (Le et al. (2016)). To overcome the impacts of violating this assumption, we extend this experimental protocol to an episodic learning framework.

In particular, this framework iteratively alternates between running experiments with an intermediate controller (or roll-outs in reinforcement learning (Kober et al. (2013))) to collect data, and using the newly collected data to synthesize a new controller. Thus learning a and b is integrated with improving the safety of the system. The new controller can be synthesized similarly to the safety-critical controller (CBF-QP), but utilizing the updated estimate of the CBF time derivative given in (8):

This controller effectively finds the nearest control input to the hand-designed controller renders the system safe according to the estimator (8). Thus, the actual safety achieved by the system degrades if there is error present in (8).

To mitigate this remaining error, we use the newly synthesized controller to improve our estimator. One method for reducing this error is to run experiments and use conventional supervised regression to update the estimator. As previously noted, conventional supervised regression faces limitations with non-i.i.d data. These limitations can be overcome episodically by utilizing reduction techniques, whereby a sequential prediction problem is reduced to a sequence of supervised learning problems (Ernst et al. (2005); Ross et al. (2011)). In each episode, data is generated using a different controller. The data set is aggregated with all previously collected data and a new ERM problem (9) is solved over the full data set. Our approach draws inspiration from the DAgger algorithm (Ross et al. (2010)), with a key difference: DAgger is a model-free policy learning algorithm, which trains a policy directly with an optimal policy oracle. Our method does not receive information on the optimal policy nor does it train a policy directly, but learns information about the unmodeled dynamics impacting safety and indirectly determines a policy via (LCBF-QP).

Lastly, as the newly synthesized controller will expose the system to new regions of the state space in which the estimator may not be accurate, the synthesized controller is blended with the nominal controller using heuristically chosen weights, , that reflect the trust in the learned model. This effectively limits how quickly the system’s behavior can change. The episodic framework is summarized in Algorithm 1.

5. Simulation & Experimental Results

In this section we apply the episodic learning algorithm developed in Sections 3 and 4 to the Segway platform. In particular, we consider a 4-dimensional asymmetrical planar Segway model as in Gurriet et al. (2018), seen in Figure 1 and 2. The state of the system consists of the horizontal position, x, velocity, , pitch angle, , and pitch angle rate . Control input to a motor in the system’s wheel is specified as a percentage of the systems battery voltage, which leads to a torque. This model permits an affine control system as per (1). Stabilization of this system to an equilibrium configuration is done using a hand-tuned proportional-derivative (PD) controller,

Safety of the Segway system is often encoded as limitations on how far and how fast the Segway is allowed to tip from an equilibrium configuration. This appears mathematically as the Control Barrier Function on the pitch angle and pitch angle rate:

where is a limit on how far the Segway can tip, is an equilibrium angle, and the coefficient c scales the importance of in defining safety. As h is a CBF, the controller (CBF-QP) can be used to ensure the safety of the system.

To evaluate the impact of model uncertainty on the CBF’s ability to ensure the safety of the system, we perturb the mass and electrical parameters of the Segway model by up to 15%, but withhold this uncertain model from the controller (CBF-QP). Figure 1 shows that the model-based controller is unable to achieve safety, with the state of the system leaving the 0-superlevel set of h (left), and the value of h falling below 0 (right).

We deploy our episodic learning framework on the uncertain Segway system to overcome this model uncertainty and achieve safety. In particular, we conduct a sequence of 10 experiments with varying initial conditions reflecting disturbances to the Segway. Data from each experiment is aggregated into one dataset that is used to train regression models. For this system we use neural-networks with one hidden layer of 200 nodes for the estimators . These networks are trained to minimize mean absolute error using stochastic gradient descent (SGD)1. After each episode the controller (LCBF-QP) is blended with the original controller (CBF-QP) using weights that grow linearly across the episodes. Figure 1 shows the behavior of the system when the controller (LCBF-QP) is deployed after episodic learning. We see that the state of the system is kept within the 0-superlevel set of h (left), with the value of h being kept above 0 (right). This indicates that the learning-augmented controller is able to keep the system safe even with model uncertainty.

To further demonstrate the ability of this learning approach, we deployed it on the physical Segway system seen in Figure 2. The objective of the Segway was specified as tracking a desired horizontal velocity profile while satisfying a barrier function on the pitch angle rate specified as:

The desired velocity profile led to a violation of the barrier function when only enforcing the safety constraint using model information. A series of 3 episodes were conducted tracking this velocity profile without introducing learned information. The estimators were implemented as neural networks with two hidden layers of 50 nodes and trained on this data after which they were incorporated into the controller using . This high weighting was used to see noticeable changes in behavior of the Segway after learning. The improvement in safety using learning can be seen in Figure 2.

Figure 1. Simulation results using the model-based CBF controller (CBF-QP) (green) and learning-augmented controller (LCBF-QP) (blue). Episodic data appears as red traces. (a) Segway dynamics simulation CAD model. (b) The phase portrait showing the evolution of the state of the system leaves the safe set (black ellipse) with the model-based controller, while it remains within using the learning-augmented controller. (c) The value of h drops below zero (twice) using the model-based controller, while it remains above zero using the learning-augmented controller. Video can be found at

Figure 2. Experimental results using the model-based CBF controller (CBF-QP) (green) and learning-augmented controller (LCBF-QP) (blue). (a) Custom robotic Ninebot Segway platform. (b) The phase portrait showing the evolution of the state of the system leaves the safe set (black strip) with the model-based controller, while it remains within using the learning-augmented controller. (c) The value of h drops below zero (at t = 3) using the model-based controller, while it remains above zero using the learning-augmented controller. Video can be found at

6. Related Work

Our work combines the idea of Control Barrier Functions from model-based control theory with elements from supervised learning, developing an episodic framework for directly learning model uncertainty as it impacts safe behavior. This relates to the idea of using model-based methods for ensuring safety with learning to reduce model uncertainty more broadly, as detailed below.

uses Gaussian Processes (GPs) in conjunction with barrier functions to explore a region which is certifiably forward invariant in the context of quadrotors. Using methods from adaptive control, Taylor and Ames (2019); Fan et al. (2019) update estimates of CBF dynamics to ensure safety. Without using barrier functions, Aswani et al. (2013); Koller et al. (2018) deploy learning in the context of model-predictive control (MPC), which choose control inputs via dynamic programming to avoid unsafe states.

Region-of-Attraction Estimation: Region-of-Attraction (ROS) estimation focuses on safely learning a region in the state space from which the system is guaranteed to converge to a desired equilibrium point. Much of this theory is motivated by the notion of Lyapunov stability from nonlinear control theory (Khalil (2002)), which implies a stricter definition of safety as it requires not only forward invariance, but also convergence. Berkenkamp et al. (2016a) begins with a stabilizing controller and safely explores the ROA for that controller. Berkenkamp et al. (2017) develops upon this using ROA in conjunction with reinforcement learning to safely to improve a policy to maximize the ROA. Taylor et al. (2019a) develops a data-driven approach to evaluate regions over which projection-to-state stability (Sontag (1989)) holds, studying how learning error impacts stability.

Learning Lyapunov Functions: Learning Lyapunov functions encompasses a variety of different approaches for certifying the stricter condition of stability to ensure safety guarantees. Chow et al. (2018) focuses on learning Lyapunov functions for discrete Markov Decision Processes. Richards et al. (2018) uses a neural-network to model a Lyapunov function that describes a maximum ROA, and Gallieri et al. (2019) learns both a discrete Lyapunov function and a stabilizing policy. Khansari-Zadeh and Billard (2014) focuses on learning Control Lyapunov Functions (CLFs) (Artstein (1983)) from data for robotic reaching motions, while Taylor et al. (2019b) motivates the work in this paper in the context of CLFs by learning uncertainty in a given CLF’s time derivative. While explicitly not learning Lyapunov functions, Berkenkamp and Schoellig (2015) ensures stability and thus safety during learning for linear systems.

Reachable Set Learning: Reachable Set learning focuses on learning what states are reachable by the system and developing policies to limit the reachable set so as to avoid unsafe states. Gillula (2011); Gillula and Tomlin (2012) formulates an approach to safe online learning via Hamilton-Jacobi-Isaacs (HJI) reachability and demonstrates it in a target-tracking context. Akametalu et al. (2014) uses GPs to estimate the unmodeled dynamics and better quantify the reachable set. Fisac et al. (2018) summarizes these preceding results theoretically and demonstrates it experimentally.

Performance-Based Safety: Performance-based safety relates safety to a minimum level of performance achieved by a deployed policy. Sui et al. (2015) develops an algorithmic approach for safely exploring different policies while maintaining a performance threshold. The work in Berkenkamp et al. (2016b) extends this algorithmic work to tuning controller parameters for discrete dynamic systems and demonstrates it on a quadrotor platform.

7. Conclusion

We presented an episodic learning framework that integrates with Control Barrier Functions, a model-based nonlinear control method for ensuring safety. Our method is able to learn unmodeled dynamics and parametric error as they directly impact the safety of the system and incorporate this information into an optimization based controller. We demonstrate the ability of this method to improve the safety of a Segway system in simulation and experimentally on hardware.

References

A. K. Akametalu, J. F. Fisac, J. H. Gillula, S. Kaynama, M. N. Zeilinger, and C. J. Tomlin. Reachability-based safe learning with gaussian processes. In 53rd IEEE Conference on Decision and Control, pages 1424–1431. IEEE, 2014.

A. Ames, J. Grizzle, and P. Tabuada. Control barrier function based quadratic programs with appli- cation to adaptive cruise control. In 53rd IEEE Conference on Decision and Control, 2014.

A. D. Ames, X. Xu, J. W. Grizzle, and P. Tabuada. Control barrier function based quadratic programs for safety critical systems. IEEE Transactions on Automatic Control, 62(8):3861–3876, 2017.

A. D. Ames, S. Coogan, M. Egerstedt, G. Notomista, K. Sreenath, and P. Tabuada. Control barrier functions: Theory and applications. arXiv preprint arXiv:1903.11199, 2019.

Z. Artstein. Stabilization with relaxed controls. Nonlinear Analysis: Theory, Methods & Applications, 7(11):1163–1173, 1983.

A. Aswani, H. Gonzalez, S. S. Sastry, and C. Tomlin. Provably safe and robust learning-based model predictive control. Automatica, 49(5):1216–1226, 2013.

F. Berkenkamp and A. P. Schoellig. Safe and robust learning control with gaussian processes. In 2015 European Control Conference (ECC), pages 2496–2501. IEEE, 2015.

F. Berkenkamp, R. Moriconi, A. P. Schoellig, and A. Krause. Safe learning of regions of attraction for uncertain, nonlinear systems with gaussian processes. In 2016 IEEE 55th Conference on Decision and Control (CDC), pages 4661–4666. IEEE, 2016a.

F. Berkenkamp, A. P. Schoellig, and A. Krause. Safe controller optimization for quadrotors with gaussian processes. In 2016 IEEE International Conference on Robotics and Automation (ICRA), pages 491–496. IEEE, 2016b.

F. Berkenkamp, M. Turchetta, A. Schoellig, and A. Krause. Safe model-based reinforcement learn- ing with stability guarantees. In I. Guyon, U. V. Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, and R. Garnett, editors, Advances in Neural Information Processing Systems 30, pages 908–918. Curran Associates, Inc., 2017.

F. Blanchini. Set invariance in control. Automatica, 35(11):1747–1767, 1999.

R. Cheng, G. Orosz, R. M. Murray, and J. W. Burdick. End-to-end safe reinforcement learning through barrier functions for safety-critical continuous control tasks. In AAAI Conference on Artificial Intelligence (AAAI), 2019.

Y. Chow, O. Nachum, E. Duenez-Guzman, and M. Ghavamzadeh. A lyapunov-based approach to safe reinforcement learning. In S. Bengio, H. Wallach, H. Larochelle, K. Grauman, N. CesaBianchi, and R. Garnett, editors, Advances in Neural Information Processing Systems 31, pages 8092–8101. Curran Associates, Inc., 2018.

G. Chowdhary, H. A. Kingravi, J. P. How, and P. A. Vela. Bayesian nonparametric adaptive control using gaussian processes. IEEE transactions on neural networks and learning systems, 26(3): 537–550, 2015.

D. Ernst, P. Geurts, and L. Wehenkel. Tree-based batch mode reinforcement learning. Journal of Machine Learning Research, 6(Apr):503–556, 2005.

D. D. Fan, J. Nguyen, R. Thakker, N. Alatur, A.-a. Agha-mohammadi, and E. A. Theodorou. Bayesian learning-based adaptive control for safety critical systems. arXiv preprint arXiv:1910.02325, 2019.

J. F. Fisac, A. K. Akametalu, M. N. Zeilinger, S. Kaynama, J. Gillula, and C. J. Tomlin. A general safety framework for learning-based control in uncertain robotic systems. IEEE Transactions on Automatic Control, 2018.

M. Gallieri, S. S. M. Salehian, N. E. Toklu, A. Quaglino, J. Masci, J. Koutn´ık, and F. Gomez. Safe interactive model-based learning. arXiv preprint arXiv:1911.06556, 2019.

C. J. Gillula, J. H .and Tomlin. Guaranteed safe online learning of a bounded system. In 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems, pages 2979–2984. IEEE, 2011.

J. H. Gillula and C. J. Tomlin. Guaranteed safe online learning via reachability: tracking a ground target using a quadrotor. In 2012 IEEE International Conference on Robotics and Automation, pages 2723–2730. IEEE, 2012.

T. Gurriet, A. Singletary, J. Reher, L. Ciarletta, E. Feron, and A. Ames. Towards a framework for realizable safety critical control through active set invariance. In Proc. of the 9th ACM/IEEE International Conf. on Cyber-Physical Systems, pages 98–106. IEEE Press, 2018.

L. Gy¨orfi, M. Kohler, A. Krzyzak, and H. Walk. A distribution-free theory of nonparametric regression. Springer Science & Business Media, 2006.

M. Jankovic. Robust control barrier functions for constrained stabilization of nonlinear systems. Automatica, 96:359–367, 2018.

H.K. Khalil. Nonlinear Systems - 3rd Edition. PH, Upper Saddle River, NJ, 2002.

S. M Khansari-Zadeh and A. Billard. Learning control lyapunov function to ensure stability of dy- namical system-based robot reaching motions. Robotics and Autonomous Systems, 62(6), 2014.

J. Kober, J. A. Bagnell, and J. Peters. Reinforcement learning in robotics: A survey. The International Journal of Robotics Research, 32(11):1238–1274, 2013.

S. Kolathaya and A. D. Ames. Input-to-state safety with control barrier functions. IEEE control systems letters, 3(1):108–113, 2018.

T. Koller, F. Berkenkamp, M. Turchetta, and A. Krause. Learning-based model predictive control for safe exploration. In 2018 IEEE Conf. on Decision and Control (CDC), pages 6059–6066. IEEE, 2018.

H. M. Le, A. Kang, Y. Yue, and P. Carr. Smooth imitation learning for online sequence prediction. In Proceedings of the 33rd International Conference on International Conference on Machine Learning-Volume 48, pages 680–688. JMLR. org, 2016.

B. Morris, M. J. Powell, and A. D. Ames. Sufficient conditions for the lipschitz continuity of qp- based multi-objective control of humanoid robots. In 52nd IEEE Conference on Decision and Control, pages 2920–2926. IEEE, 2013.

Q. Nguyen and K. Sreenath. Exponential control barrier functions for enforcing high relative-degree safety-critical constraints. In 2016 American Control Conference (ACC), pages 322–328, 2016.

L. Perko. Differential equations and dynamical systems, volume 7. Springer S& B Media, 2013.

S. M. Richards, F. Berkenkamp, and A. Krause. The lyapunov neural network: Adaptive stability certification for safe learning of dynamic systems. In Conference on Robot Learning, 2018.

S. Ross, G. J. Gordon, and J. A. Bagnell. No-regret reductions for imitation learning and structured prediction. CoRR, abs/1011.0686, 2010.

S. Ross, G. Gordon, and D. Bagnell. A reduction of imitation learning and structured prediction to no-regret online learning. In Proceedings of the fourteenth international conference on artificial intelligence and statistics, pages 627–635, 2011.

S. S. Sastry. Nonlinear Systems: Analysis, Stability and Control. Springer, NY, 1999.

M. Saveriano and D. Lee. Learning barrier functions for constrained motion planning with dynam- ical systems. 2019.

S. Schaal and C. G. Atkeson. Learning control in robotics. IEEE Robotics & Automation Magazine, 17(2):20–29, 2010.

G. Shi, X. Shi, M. O’Connell, R. Yu, K. Azizzadenesheli, A. Anandkumar, Y. Yue, and S. Chung. Neural lander: Stable drone landing control using learned dynamics. In IEEE International Conference on Robotics and Automation (ICRA), 2019.

E. D. Sontag. A universal construction of artstein’s theorem on nonlinear stabilization. Systems & control letters, 13(2):117–123, 1989.

Y. Sui, A. Gotovos, J. Burdick, and A. Krause. Safe exploration for optimization with gaussian processes. In International Conference on Machine Learning, pages 997–1005, 2015.

A. J. Taylor and A. D. Ames. Adaptive safety with control barrier functions. arXiv preprint arXiv:1910.00555, 2019.

A. J. Taylor, V. D. Dorobantu, M. Krishnamoorthy, H. M. Le, Y. Yue, and A. D. Ames. A control lyapunov perspective on episodic learning via projection to state stability. In IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2019a.

A. J. Taylor, V. D. Dorobantu, H. M. Le, Y. Yue, and A. D. Ames. Episodic learning with control lyapunov functions for uncertain robotic systems. arXiv preprint arXiv:1903.01577, 2019b.

L. Wang, E. A. Theodorou, and M. Egerstedt. Safe learning of quadrotor dynamics using barrier certificates. In 2018 IEEE International Conference on Robotics and Automation (ICRA), 2018.

X. Xu, P. Tabuada, J. W. Grizzle, and A. D. Ames. Robustness of control barrier functions for safety critical control. IFAC-PapersOnLine, 48(27):54–61, 2015.

designed for accessibility and to further open science