1
DeepSeek Open Sources DeepSeek R1 LLM with Performance Comparable To OpenAI's O1 Model
avmquinton459 edited this page 2 months ago
DeepSeek open-sourced DeepSeek-R1, larsaluarna.se an LLM fine-tuned with reinforcement learning (RL) to improve reasoning ability. DeepSeek-R1 attains outcomes on par with OpenAI's o1 model on numerous criteria, including MATH-500 and SWE-bench.
DeepSeek-R1 is based on DeepSeek-V3, a mixture of professionals (MoE) model recently open-sourced by DeepSeek. This base model is fine-tuned using Group Relative Policy Optimization (GRPO), a reasoning-oriented version of RL. The research group likewise performed knowledge distillation from DeepSeek-R1 to open-source Qwen and Llama designs and released several variations of each