Tencent Hy4

Tencent Hy4 is a flagship Mixture-of-Experts (MoE) language and multimodal model developed by Tencent. Featuring a total parameter count of 770 billion with 49 billion active parameters per token, the model represents a major advancement in long-horizon task execution, instruction following, and enterprise workflow automation. Building upon earlier iterations, Hy4 integrates advanced visual understanding and computer-use capabilities for the first time, allowing it to interact natively with both command-line interfaces and graphical user interfaces.

Architecture and Capabilities

The model is structured around a scalable MoE backbone paired with a massive 1 million-token context window, enabling deep synthesis of extensive information across multiple files and sources. Tencent has tuned Hy4 on specialized professional software data, including CAD and Blender workflows, which significantly enhances its capacity for complex software engineering, technical problem-solving, and domain-specific code generation. Furthermore, comprehensive safety audits and red-teaming protocols were conducted to balance high-performance reasoning with robust operational safeguards.