According to the Hangzhou-based startup, users of its official application programming interface through Harness were consuming approximately 92 trillion tokens per day as of November 4. That is equivalent to about 1.1 billion tokens consumed per second.
A harness is the software infrastructure that turns a large language model into an AI agent capable of autonomously executing tasks on behalf of users, rather than simply responding to prompts.