@suresk.bsky.social
Hard to find super specific numbers, but 4j per token seems to be a common and reasonable eating, which would mean most chats are a few Wh or less. This paper goes into it a bit more - arxiv.org/pdf/2310.03003
arxiv.org
February 18, 2025 at 1:07 AM
Hard to find super specific numbers, but 4j per token seems to be a common and reasonable eating, which would mean most chats are a few Wh or less. This paper goes into it a bit more - arxiv.org/pdf/2310.03003