Kimi K3 Integrates with Claude Code, Task Costs 9 Times Higher than Kimi Code

AI infrastructure company Composio has integrated Kimi K3 with Kimi Code, Hermes, and Claude Code, completing 28 identical tasks. Kimi Code completed 22 tasks, Hermes completed 21 tasks, and Claude Code completed 20 tasks. The median token usage per task was 61,000, 67,000, and 340,000 respectively. The average cost per task was approximately $0.22, $0.28, and $2, with some tasks differing in token usage by as much as 30 times. Hermes was the fastest, with a median time of 179 seconds per task, followed by Kimi Code at 297 seconds and Claude Code at 348 seconds. Another study showed that after replacing the operating framework on 22 enterprise tasks across 6 models, token usage decreased by 38%, individual costs dropped by 41%, and time spent decreased by 44%, while the quality of completion remained largely unchanged.