Biostatistics seminar
Assistant Professor Oh-Ran Kwon will give a talk titled "Black-Box Knowledge Transfer across Distinct Feature Sets."
About
Oh-Ran Kwon, PhD is an assistant professor at the Department of Statistics in the College of Arts and Sciences at Ohio State.
Lunch will be provided during the seminar.
Abstract
Pre-trained black-box predictive functions encode knowledge distilled from massive datasets and extensive computation. However, when the available input features differ from those the black box expects, direct use is infeasible. In this talk, we introduce a method for transferring predictive knowledge from the black box to a new, heterogeneous input space. Our approach decomposes the target regression function into a transferable component, which the black box can inform, and a non-transferable component, which captures information unique to the new space. We propose a two-step neural network procedure, estimating the transferable component from abundant unlabeled feature pairs that bridge the two input spaces and the non-transferable component from limited labels. We derive prediction risk bounds that improve on those of a non-transfer alternative when the non-transferable component is small or smooth, and the procedure adapts to either case. We extend the framework to multiple black boxes, each on its own input space, and show that aggregation can reduce prediction error relative to the best single black box. Simulated and real data demonstrate the practical value of the method
Contact
Andy Ni