In this article, we study the pricing and resource management in the Internet of Things (IoT) system with blockchain-as-a-service (BaaS) and mobile-edge computing (MEC). The BaaS model includes the cloud-based server to perform blockchain tasks and the set of peers to collect data from local IoT devices. The MEC model consists of the set of terrestrial and aerial base stations (BSs), i.e., unmanned aerial vehicles (UAVs), to forward the tasks of peers to the BaaS server. Each BS is also equipped with an MEC server to run some blockchain tasks. As the BSs can be privately owned or controlled by different operators, there is no information exchange among them. We show that the resource management and pricing in the BaaS-MEC system are modeled as a stochastic Stackelberg game with multiple leaders and incomplete information about actions of leaders/BSs and followers/peers. We formulate a novel hierarchical reinforcement learning (RL) algorithm for the decision makings of BSs and peers. We also develop an unsupervised hierarchical deep learning (HDL) algorithm that combines deep Q -learning (DQL) for BSs with the Bayesian deep learning (BDL) for peers. We prove that the proposed algorithms converge to stable states in which the peers' actions are the best responses to optimal actions of BSs.
Funding
National Natural Science Foundation of China (NSFC): project 61950410603
Singapore NRF National Satellite of Excellence, Design Science and Technology for Secure Critical Infrastructure NSoE DeST-SCI2019-0007
A*STAR-NTU-SUTD Joint Research Grant Call on Artificial Intelligence for the Future of Manufacturing RGANS1906
WASP/NTU: grant M4082187 (4080)
Singapore MOE Tier 1: grant 2017-T1-002-007 RG122/17
Singapore MOE Tier 2: grant MOE2014-T2-2-015 ARC4/15
Singapore NRF: grant 2015-NRF-ISF001-2277
Singapore EMA Energy Resilience: grant NRF2017EWT-EP003-041
History
School
Science
Department
Computer Science
Published in
IEEE Internet of Things Journal
Volume
7
Issue
3
Pages
1974 - 1993
Publisher
Institute of Electrical and Electronics Engineers (IEEE)