歷史演講・100 學年度上學期
201111/16週三 演講

Metric Entropy and Power of Statistical Learning

Prof. Yuhong YangUniversity of Minnesota 下午 13:30–14:30 鴻經館 107 室
摘要: Metric entropy, a concept invented by Kolmogorov, plays a fundamental role on optimal statistical estimation. It determines how well an unknown function in a given target class can be learned. Efforts have been directed at obtaining flexible learning procedures that optimally adapt to various possible characteristics of the data generating mechanism. A question that addresses the issue of how far one can go in this direction is: Given a regression procedure, however sophisticated it is, how many regression functions are estimated accurately? In this work, for a given sequence of prescribed estimation accuracy (in sample size), we give an upper bound (in terms of metric entropy) on the number of regression functions for which the accuracy is achieved. Interesting consequences on adaptive and sparse estimations are also given.