

Julien Delavande , an engineer at AI research firm Hugging Face , has developed a tool that shows in real time the power consumption of the chatbot generating
gnnnnnngh
this shit pisses me off so bad
thereās actually quantifiable shit you can use across vendors[0]. thereās even some software[1] you can just slap in place and get some good free easy numbers with! these things are real! and are usable!
āmeasure the power consumption of the chatbot generatingā
Iām sorry you fucking what? just how exactly are you getting wattage out of openai? are you lovingly coaxing the model to lie to you about total flops spent?
[0] - intelās def been better on this for a while but leaving that aside for nowā¦
[1] - itās very open source! (when I last looked there was no continual in-process sampling so you got hella at-observation sampling problems; but, yāknow, can be dealt with)
Didnāt know it had come out but I was wondering if theyād manage to continue s2 like s1
Also worried for the next season of the boysā¦