Learning to Lead a Unicorn