Command Palette
Search for a command to run...
One-click Deployment of DeepSeek-V2-Lite-Chat
This tutorial is a one-click deployment demo of DeepSeek-V2-Lite-Chat. You only need to clone and start the container and directly copy the generated API address to experience the model inference.
1. Introduction to the model
DeepSeek-V2, a powerful mixture of experts (MoE) language model, is characterized by economical training and efficient inference. It contains a total of 236B parameters, of which 21B parameters are activated per token. Compared with DeepSeek 67B, DeepSeek-V2 achieves stronger performance while saving 42.5% of training cost, reducing 93.3% of KV cache, and increasing the maximum generation throughput to 5.76 times.
2. Evaluation Results
| Benchmark | Domain | QWen1.5 72B Chat | Mixtral 8x22B | LLaMA3 70B Instruct | DeepSeek-V1 Chat (SFT) | DeepSeek-V2 Chat (SFT) | DeepSeek-V2 Chat (RL) |
|---|---|---|---|---|---|---|---|
| MMLU | English | 76.2 | 77.8 | 80.3 | 71.1 | 78.4 | 77.8 |
| BBH | English | 65.9 | 78.4 | 80.1 | 71.7 | 81.3 | 79.7 |
| C-Eval | English | 82.2 | 60.0 | 67.9 | 65.2 | 80.9 | 78.0 |
| CMMLU | English | 82.9 | 61.0 | 70.7 | 67.8 | 82.4 | 81.6 |
| HumanEval | Code | 68.9 | 75.0 | 76.2 | 73.8 | 76.8 | 81.1 |
| MBPP | Code | 52.2 | 64.4 | 69.8 | 61.4 | 70.4 | 72.0 |
| LiveCodeBench (0901-0401) | Code | 18.8 | 25.0 | 30.5 | 18.3 | 28.7 | 32.5 |
| GSM8K | Math | 81.9 | 87.9 | 93.2 | 84.1 | 90.8 | 92.2 |
| Math | Math | 40.6 | 49.8 | 48.5 | 32.6 | 52.7 | 53.9 |
3. How to use
This tutorial has deployed the model and environment. You can directly use the large model for reasoning dialogue according to the tutorial instructions. The specific tutorial is as follows:
Step 1: Clone and start the container
After cloning and starting the container successfully, you will see this interface. Wait for a dozen seconds to load the model and copy the API address on the right to the browser. 
Step 2: Enter the website
After entering the webpage, you can communicate with the large model (the relevant parameters have been debugged and no adjustment is required) 
Discussion and Exchange
🖌️ If you see a high-quality project, please leave a message in the background to recommend it! In addition, we have also established a tutorial exchange group. Welcome friends to scan the QR code and remark [Tutorial Exchange] to join the group to discuss various technical issues and share application effects↓
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.