Glossary / Distillation
Training a smaller model to copy the outputs of a larger one, producing a cheaper model that keeps much of the original's ability. Some labs accuse rivals of distilling their models without permission.
Also written as: distilled, distilling