I used to be into ML back in the R-CNN, GAN, ResNet era and would read papers/blogs.

Seems like ML is taking off recently and I want to get back into it! So far on my list I have attention is all you need, qlora, llama’s and q learning. Suggestions?

There is a discussion on Hacker News, but feel free to comment here as well.

  • kwedd@feddit.nlEnglish
    1·
    11 months ago

    I can’t speak for the current state of the art, like the ANN’s used by LLM’s like ChatGPT, but I have some ideas about the future of neural networks. I think there’s a future in networks based on Predictive Coding, which are more versatile, and also in SNN’s implemented on neuromorphic hardware.

    “Opportunities for neuromorphic computing algorithms and applications” by Schuman et al. provides a good overview of neuromorphic computing.

    For an overview of Predictive Coding see “Predictive Coding: a Theoretical and Experimental Review” by Millidge et al.