Adapting to Latent Subgroup Shifts via Concepts and Proxies