6 comments

  • 13 分钟前
    undefined
  • kevmo31423 小时前
    I like the use of the functional API here. I learned through a similar route and it was very helpful for me compared to trying to understand `torch.nn.Module`.

    Here's a gist of my learning path if it's helpful to anyone: https://gist.github.com/kevmo314/294001659324429bae6749062a9...

    • therealoliver15 小时前
      Yes, these are two different learning paths. The detailed process learning is beneficial for future research, while the API-style approach is convenient and quick for getting started and using. Both are very useful!
  • simonw23 小时前
    I hadn't realized OpenAI's tiktoken Python library could work with other models outside of the OpenAI family, that's really useful: https://github.com/therealoliver/Deepdive-llama3-from-scratc...
    • moffkalast5 小时前
      It's more than just that, practically every notable open model released in the past year or so uses tiktoken as the tokenizer.
    • therealoliver15 小时前
      I'm glad to have helped you :)
  • aghilmort23 小时前
    great need; mulling over; shows up all the time in AI paradigms
  • curtisszmania23 小时前
    [dead]
  • FreebasingLLMs19 小时前
    [flagged]
    • jawr19 小时前
      If you’ve got nothing constructive to say… don’t say anything? OP brings a lot of value in a style they like, your comment brings absolutely nothing.
      • therealoliver15 小时前
        Thank you for helping me out. Such comments are really depressing.
        • GaggiX2 小时前
          Ignore the troll that cries over Anya.
        • FreebasingLLMs3 小时前
          Real life feedback: drop the anime shit. It is way out of place. I'm not kidding.
      • FreebasingLLMs3 小时前
        I said what I said with purpose. I can't share this shit with anyone serious. It looks like someone who watches too much cartoon porn made this. I'm sorry these types of real life viewpoints offend you. I do sincerely suggest you reflect on what I am saying and consider it with weight.
        • therealoliver1 小时前
          Thanks for ur feedback on the project's visual style. Let me clarify a few things: First, associating an anime character, especially a minor, with inappropriate content is unfair and disrespectful to both the character and the original work. Second, this character wasn’t added by me—it was included by the previous developer who created these visualizations. As part of the open-source community, I believe it’s important to respect the project’s history and acknowledge their contributions. Lastly, I appreciate your perspective—it might highlight how cultural differences can shape perceptions, and I’ll pay attention to that in my subsequent work. That said, I also value maintaining the entertainment and avoiding overly dry or preachy content, which I think is equally important. This will likely be my final reply on this matter. Let’s focus on being open-minded and keeping the community peaceful. Thanks again for your support of the technical aspects of the project