• Drew
    link
    fedilink
    arrow-up
    6
    ·
    14 小时前

    I don’t think it’s training from AI data, but rather distillation: which tries to mimic another model

    So there’s a difference in what’s happening, one is taking the data as input and trying to form something new, while the other is trying to recreate the input

    • seang96@spgrn.com
      link
      fedilink
      arrow-up
      3
      ·
      14 小时前

      Ah I saw it mentioned but paywall blocked the rest lol

      Distillation is basically reverse engineering for AI cool.