Deep Learnings

Tag: open models

  • Training 100 models in public

    —

    by

    David Dworetzky
    in

    One of the things that I’ve admired of individuals like Andrej Karpathy or Dwarkesh is that the work that they do is deeply public. Things like Mini GPT are both a way of advancing one’s own knowledge about the depth of craft with transformers, as well as a way of teaching and transmitting that knowledge…