LLMs, BitTorrent-style
I was pointed to this project and wanted to share it because it looks cool. I’ve tried the online chatbot but haven’t tried running a local node.
repository: https://github.com/bigscience-workshop/petals
demo: https://chat.petals.dev
Well these models are good at generating random stuff and sounding good :) A more intelligent bot would just say “I don’t know”.