Curriculum Manager for Source Selection in Multi-Source Domain Adaptation

Luyu Yang, Yogesh Balaji, Ser-Nam Lim, Abhinav Shrivastava ;

The performance of Multi-Source Unsupervised Domain Adaptation (MS-UDA) depends significantly on the effectiveness of transferring from labeled source domain samples. In this paper, we proposed an adversarial agent that learns a dynamic curriculum for source samples, called Curriculum Manager for Source Selection (CMSS). The curriculum manager, an independent network module, constantly updates the curriculum during training and iteratively learns which domains or samples are best suited for aligning to the target. The intuition behind is to force the curriculum manager to constantly re-measure the tranferability of latent domains over time to adversarially raise the error rate of the domain discriminator. CMSS does not require any knowledge of the domain labels yet it outperforms other methods on four well-known benchmarks by significant margins. We also provide interpretable results that sheds light on the proposed method. "