Response-based distillation trains the small language model (SLM) to match the output probability distribution of the large language model (LLM) across a large corpus, focusing on final outputs.

Large language models can help robots identify the skills they need to complete a certain task. Written by Liam Tung, Contributing Writer Aug. 18, 2022 at 1:02 a.m. PT Image: onurdongel / GettyImages ...

Actually building such a language model, though, is a big job. This is where AI —or machine learning, a particular subfield of AI —comes in.