Arsip Kuliah Umum・Semester Genap 2015/2016
201603/31Kam Kuliah Umum

Markov Decision Processes and Their Applications in Resource Allocation

劉聚仁教授清華大學 下午 3:30–5:00 Gedung Hongjing 107 室
Abstract: In-home Smart Grid, the integration of the renewable power systems with the conventional power systems, calls for cost-effective management for the electricity usages of end users’ household appliances. In this talk, we will first describe how to use the queuing theory to develop an analytical model for the electricity consumption within a community. In view of the fact that the conventional power system has sufficient energy to supply power demands from the end users consistently, whereas the power supplied by the renewable power system is intermittent, depending on the availability of renewable energy sources (e.g., solar or wind energy). By applying the theory of finite-horizon continuous-time Markov decision processes, we obtain a threshold policy. According to this threshold policy, the in-home smart meter can determine whether the power demands should be served by the conventional power system or the renewable power system. Numerical results show that the threshold policy can manage the electricity usage very effectively.