WolfLink@sh.itjust.workstoTechnology@lemmy.world•‘Thirsty’ ChatGPT uses four times more water than previously thoughtEnglish
2·
1 day agoI’ve run an LLM on my desktop GPU and gotten decent results, albeit not nearly as good as what ChatGPT will get you.
Probably used less than 0.1Wh per response.
Inference only. I’m looking into doing some fine tuning. Training from scratch is another story.