Open-Source AI and Open Models Reading List

(interconnects.ai)

51 points | by simonpure 4 hours ago

2 comments

  • petcat 1 hour ago
    > Open-Source AI

    There are no open source AI models, at least not useful ones (yet [1]). Open weight is not the same as open source. "Open weight" models are still just inscrutable binary blobs that you can (theoretically) run on your own computer instead of through a SAAS web app. The open weight model labs don't even provide a high level catalog or any description whatsoever about what went into the training data.

    This is not open source and we should stop conflating the two things.

    [1] https://allenai.org/

    • vlyan 14 minutes ago
      >The open weight model labs don't even provide a high level catalog or any description whatsoever about what went into the training data.

      because the training data full is of copyrighted works.

      the answer to "what went into the training data" is "everything we could get our hands on".

    • Gracana 34 minutes ago
      I think you would be pleasantly surprised by the content of the linked article.
    • markasoftware 44 minutes ago
      I thought Nemotron tried to be pretty open?
  • brcmthrowaway 2 hours ago
    How about learning the internals of LLMs, is Sebastian Raschka's content still the best in 2026?