Optimal Temporal Logic Control for Deterministic Transition Systems with Probabilistic Penalties

Investor logo

Warning

This publication doesn't include Faculty of Arts. It includes Faculty of Informatics. Official publication website can be found on muni.cz.
Authors

SVOREŇOVÁ Mária ČERNÁ Ivana BELTA Calin

Year of publication 2015
Type Article in Periodical
Magazine / Source IEEE Transactions on Automatic Control
MU Faculty or unit

Faculty of Informatics

Citation
Doi http://dx.doi.org/10.1109/TAC.2014.2381451
Field Informatics
Keywords optimal control; linear temporal logic (LTL)
Description We consider an optimal control problem for a weighted deterministic transition system required to satisfy a constraint expressed as a Linear Temporal Logic (LTL) formula over its labels. By assuming that the executions of the system incur time-varying penalties modeled as Markov chains, our goal is to minimize the expected average cumulative penalty incurred between consecutive satisfactions of a desired property. Using concepts from theoretical computer science, we provide two solutions to this problem. First, we derive a provably correct optimal strategy within the class of strategies that do not exploit values of penalties sensed in real time. Second, we show that by taking advantage of locally sensing the penalties, we can construct heuristic strategies leading to lower collected penalty. While still ensuring satisfaction of the LTL constraint, we cannot guarantee optimality in the latter case. We provide a user-friendly implementation of the proposed algorithms and analysis of two case studies.
Related projects:

You are running an old browser version. We recommend updating your browser to its latest version.