Peer to Peer Offloading with Delayed Feedback: An Adversary Bandit Approach

Fog computing brings computation and services to the edge of networks enabling real time applications. In order to provide satisfactory quality of experience, the latency of fog networks needs to be minimized. In this paper, we consider a peer computation offloading problem for a fog network with unknown dynamics. Peer competition occurs when different fog nodes offload tasks to the same peer FN. In this paper, the computation offloading problem is modeled as a sequential FN selection problem with delayed feedback. We construct an online learning policy based on the adversary multi-arm bandit framework to deal with peer competition and delayed feedback. Simulation results validate the effectiveness of the proposed policy. © 2020 IEEE.

Authors
Yang M.1, 2 , Zhu H.1, 2 , Wang H. 3 , Koucheryavy Y. 4 , Samouylov K. 5 , Qian H.1, 2
Publisher
Institute of Electrical and Electronics Engineers Inc.
Language
English
Pages
5035-5039
Status
Published
Number
9053680
Volume
2020-May
Year
2020
Organizations
  • 1 Chinese Academy of Sciences (CAS), Shanghai Advanced Research Institute, China
  • 2 School of Information Science and Technology, ShanghaiTech University, China
  • 3 CAS, Shanghai Institute of Microsystem and Information Technology, China
  • 4 Tampere University, Finland
  • 5 Peoples' Friendship University of Russia, Russian Federation
Keywords
adversary multi-arm bandit; delayed feed-back; Fog computing; reinforcement learning; task offloading
Share

Other records