DeepSeek-V2.5 (Dec '24)

DeepSeek-V2.5 is an upgraded Mixture-of-Experts (MoE) language model that unifies the capabilities of DeepSeek-V2-Chat and DeepSeek-Coder-V2. Released in its finalized version in December 2024, the model is designed to handle a wide range of tasks, including general-purpose conversation, advanced mathematical reasoning, and specialized software development. It supports a context length of 128,000 tokens.\n\nThe model's architecture utilizes Multi-head Latent Attention (MLA) and the DeepSeekMoE framework. These technologies are intended to optimize inference efficiency and reduce memory requirements by activating only 21 billion parameters per token out of a total 236 billion. This approach allows for high-performance generation with significantly reduced KV cache overhead compared to traditional transformer models.\n\nEnhancements in the December 2024 update specifically improved the model's performance in coding benchmarks and its ability to follow complex instructions. DeepSeek-V2.5 features support for function calling, JSON output modes, and Fill-in-the-Middle (FIM) completion, making it a versatile tool for both chat-based and programmatic applications.