Loughborough University
Browse
DCEE FinalFullversion.pdf (5.39 MB)

Dual Control for Exploitation and Exploration (DCEE) in autonomous search

Download (5.39 MB)
journal contribution
posted on 2021-09-13, 13:22 authored by Wen-Hua ChenWen-Hua Chen, Callum Rhodes, Cunjia LiuCunjia Liu
This paper proposes an optimal autonomous search framework, namely Dual Control for Exploration and Exploitation (DCEE), for a target at an unknown location in an unknown environment. Source localisation is to find sources of atmospheric hazardous material release in an unknown environment. This paper proposes a control theoretic approach to this autonomous search problem. To cope with an unknown target location, at each step, the target location is estimated by Bayesian inference. Then a control action is taken to minimise the error between future robot position and the predicted future estimation of the target location. The latter is generated by hypothesised measurements at the corresponding future robot positions (due to the control action) with the current estimation of the target location as a prior. It shows that DCEE can take into account both the error between the next robot position and the estimated target location, and the uncertainty of the estimate. This approach is further extended to deal with both an unknown source location and unknown local environment (e.g. wind speed and direction). Different from current information theoretic approaches, this new control theoretic approach achieves the optimal trade-off between exploitation and exploration in an unknown environment with an unknown target by driving the robot moving towards estimated target location while reducing its estimation uncertainty. Simulation and experimental studies demonstrate promising performance of the proposed approach. The relationships between the proposed approach, informative path planning, dual control, and classic model predictive control are discussed and compared. This work opens a door for developing control systems operating in unknown environments, or performing tasks with unknown parameters.

Funding

Goal-Oriented Control Systems (GOCS): Disturbance, Uncertainty and Constraints

Engineering and Physical Sciences Research Council

Find out more...

History

School

  • Aeronautical, Automotive, Chemical and Materials Engineering

Department

  • Aeronautical and Automotive Engineering

Published in

Automatica

Volume

133

Publisher

Elsevier

Version

  • AM (Accepted Manuscript)

Rights holder

© Elsevier

Publisher statement

This paper was accepted for publication in the journal Automatica and the definitive published version is available at https://doi.org/10.1016/j.automatica.2021.109851.

Acceptance date

2021-06-17

Publication date

2021-08-11

Copyright date

2021

ISSN

0005-1098

Language

  • en

Depositor

Prof Wen-Hua Chen. Deposit date: 7 September 2021

Article number

109851

Usage metrics

    Loughborough Publications

    Categories

    No categories selected

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC