Markov Decision Processes and Their Applications in Resource Allocation
劉聚仁教授清華大學 下午 3:30–5:00 鴻經館 107 室Abstract:
In-home Smart Grid, the integration of the renewable power systems with the conventional power systems, calls for cost-effective management for the electricity usages of end users’ household appliances. In this talk, we will first describe how to use the queuing theory to develop an analytical model for the electricity consumption within a community. In view of the fact that the conventional power system has sufficient energy to supply power demands from the end users consistently, whereas the power supplied by the renewable power system is intermittent, depending on the availability of renewable energy sources (e.g., solar or wind energy).
By applying the theory of finite-horizon continuous-time Markov decision processes, we obtain a threshold policy. According to this threshold policy, the in-home smart meter can determine whether the power demands should be served by the conventional power system or the renewable power system. Numerical results show that the threshold policy can manage the electricity usage very effectively.