WHAT WE THINK1️⃣ ByteDance has too much too lose to play the distillation game  ByteDance founder Zhang Yiming reportedly told the company's AI team not to distill rival models to improve its own model capabilities, even if that means falling behind in benchmark leaderboards. The company is playing it safe. Unlike most of its Chinese competitors like DeepSeek, Moonshot, and Z.ai, ByteDance has a consumer business in the US under intense scrutiny. Any accusation that ByteDance copied an American model could give the US more ammunition against TikTok. ByteDance has always been an outlier in China's AI ecosystem. While other labs gain attention through open-weight models, the company has kept most of its flagship models proprietary. It can afford that approach, though. ByteDance's chatbot app Doubao led China's consumer AI market with 382 million monthly active users in May, more than Qwen and DeepSeek combined. Seedance has also become an international breakout despite ByteDance trailing in the broader LLM race. Better domestic chips may eventually reduce the need for Chinese labs to distill foreign models, though ByteDance may look the other way regardless. For most Chinese labs, falling behind is the bigger threat; for ByteDance, another TikTok-sized political crisis would be much worse. 2️⃣ A 10-million context window could shrink the AI agent stack US-based AI agent startup Pokee, which we profiled last year, launched a model called Isaac. It comes with one standout claim: a context window of 10 million tokens. A context window refers to the amount of information an AI model can consider at one time. For agents, that space fills up with instructions, documents, conversation history, and tool outputs. Once it reaches the limit, information has to be removed or compressed, which can result in poor execution. AI agent startups work around this by building retrieval systems, summarizing earlier actions, discarding old tool outputs, and saving important details for the agent to use later. A larger context window lets an agent work across entire codebases and long interaction histories with fewer workarounds. In practice, Pokee's latest model allows startups to spend less time squeezing information into the prompt and more time designing workflows and evaluations. The catch is that Pokee demonstrated its context window and agent performance separately. Its 10-million-token result comes from a controlled internal test, while its agent benchmarks do not use the full context window. Independent testing needs to show whether the larger context window actually makes agents better, rather than simply allowing them to take in more information. |
