• TheBlackLounge@lemmy.world
    link
    fedilink
    English
    arrow-up
    22
    ·
    edit-2
    11 months ago

    Distilling has been around since forever. It’s a legitimate technique that can give you a better model depending on your needs.

    OpenAI does it too to improve its models.