Distillation

BytapaScript

What it means

Training a smaller model to imitate the capabilities or behaviour of a larger model.

💡 An experienced teacher creating a simplified study guide with the most important lessons.

Why it matters

It can create smaller, cheaper and faster models for specific tasks.

Related terms

Learn Full Stack

with tapaScript

By clicking Sign Up you re confirming that you agree with our Terms and Conditions.

newsletter

Don't forget to connect with us on