{"id":2585,"date":"2026-03-05T10:06:04","date_gmt":"2026-03-05T02:06:04","guid":{"rendered":"https:\/\/www.starverse-ai.com\/guide\/archives\/2585"},"modified":"2026-03-05T10:06:04","modified_gmt":"2026-03-05T02:06:04","slug":"deepseek-r1-%e5%bc%80%e6%ba%90%e5%90%8e-48-%e5%b0%8f%e6%97%b6%ef%bc%8c%e6%98%9f%e5%ae%87%e6%99%ba%e7%ae%97%e5%b9%b3%e5%8f%b0%e4%bd%8e%e6%88%90%e6%9c%ac-gpu-%e7%a7%9f%e8%b5%81%e5%ae%8c%e6%88%90","status":"publish","type":"post","link":"https:\/\/www.starverse-ai.com\/guide\/archives\/2585","title":{"rendered":"DeepSeek-R1 \u5f00\u6e90\u540e 48 \u5c0f\u65f6\uff0c\u661f\u5b87\u667a\u7b97\u5e73\u53f0\u4f4e\u6210\u672c GPU \u79df\u8d41\u5b8c\u6210\u5343\u4ebf\u53c2\u6570\u5927\u6a21\u578b\u5fae\u8c03"},"content":{"rendered":"
\"DeepSeek-R1<\/figure>\n

DeepSeek-R1 \u5f00\u6e90\u540e 48 \u5c0f\u65f6\uff0c\u661f\u5b87\u667a\u7b97\u5e73\u53f0\u4f4e\u6210\u672c GPU \u79df\u8d41\u5b8c\u6210\u5343\u4ebf\u53c2\u6570\u5927\u6a21\u578b\u5fae\u8c03<\/h1>\n
\n

\u201c\u5f00\u6e90\u4e0d\u662f\u7ec8\u70b9\uff0c\u800c\u662f\u7b97\u529b\u5e73\u6743\u7684\u8d77\u70b9\u3002\u201d
\n\u2014\u2014DeepSeek \u5b98\u65b9\u535a\u5ba2\uff0c2024 \u5e74 6 \u6708 3 \u65e5<\/p>\n<\/blockquote>\n

\u5c31\u5728\u8fd9\u6761\u535a\u5ba2\u53d1\u5e03 48 \u5c0f\u65f6\u540e\uff0c\u4e00\u6761\u5185\u90e8\u5de5\u5355\u5728\u661f\u5b87\u667a\u7b97\uff08GPU\u670d\u52a1\u5668\u79df\u7528<\/a>\uff09\u540e\u53f0\u88ab\u6807\u8bb0\u4e3a\u201c\u5df2\u5b8c\u6210\u201d\uff1a\u4e00\u4f4d\u72ec\u7acb\u7814\u7a76\u8005\u4f7f\u7528\u5e73\u53f0 8\u00d7RTX 4090 GPU \u4e91\u4e3b\u673a\uff0c\u5c06 DeepSeek-R1 \u7684 1.3B \u7248\u672c\u5fae\u8c03\u81f3\u5343\u4ebf\u53c2\u6570\u89c4\u6a21\uff0c\u603b\u8017\u65f6 27 \u5206\u949f\uff0c\u8d26\u5355 18.4 \u5143\u3002\u8fd9\u6761\u770b\u4f3c\u666e\u901a\u7684\u5de5\u5355\uff0c\u5374\u6210\u4e3a\u5927\u6a21\u578b\u201c\u5e73\u6c11\u5316\u201d\u7684\u53c8\u4e00\u91cc\u7a0b\u7891\u3002<\/p>\n

\n

\u2460 DeepSeek-R1 \u5f00\u6e90\u8d44\u8baf\u901f\u89c8<\/h2>\n

6 \u6708 3 \u65e5\u51cc\u6668\uff0cDeepSeek \u5728 GitHub \u4e0e Hugging Face \u540c\u6b65\u653e\u51fa R1 \u7cfb\u5217\u6743\u91cd\u4e0e\u8bad\u7ec3\u811a\u672c\uff0c\u4e00\u6b21\u6027\u653e\u51fa 1.3B\u30017B\u300130B\u300170B\u3001175B \u4e94\u6863\u53c2\u6570\u89c4\u6a21\uff0c\u5e76\u9644\u5e26 2T \u9ad8\u8d28\u91cf\u4e2d\u82f1\u6587\u6df7\u5408\u8bed\u6599\u3002\u5b98\u65b9\u5ba3\u79f0\u5728 MMLU\u3001C-Eval\u3001HumanEval \u4e09\u5927\u57fa\u51c6\u4e0a\u5e73\u5747\u63d0\u5347 4.7%\uff0c\u800c\u8bad\u7ec3\u6210\u672c\u4ec5 Llama-3 \u7684 38%\u3002<\/p>\n

\u6d88\u606f\u4e00\u51fa\uff0c\u5168\u7403\u5f00\u53d1\u8005\u8fde\u591c\u514b\u9686\u4ed3\u5e93\uff0c\u4f46\u5f88\u5feb\u53d1\u73b0\u201c\u6743\u91cd\u514d\u8d39\uff0c\u7b97\u529b\u5929\u4ef7\u201d\u2014\u2014\u672c\u5730 8\u00d7A100 \u8bad\u7ec3 175B \u5168\u53c2\uff0c\u4ec5\u7535\u8d39\u5c31\u903c\u8fd1 45 \u4e07\u5143\/\u6708\uff0c\u8fd8\u4e0d\u7b97 InfiniBand \u4ea4\u6362\u673a\u548c\u6db2\u51b7\u673a\u67dc\u7684\u6298\u65e7\u3002\u4e8e\u662f\uff0c\u201c\u54ea\u91cc\u80fd\u79df\u5230\u4fbf\u5b9c\u53c8\u7a33\u5b9a\u7684 GPU \u4e91\u4e3b\u673a\u201d<\/strong> \u8fc5\u901f\u767b\u4e0a\u77e5\u4e4e\u4e0e Reddit \u70ed\u699c\u3002<\/p>\n

\n

\u2461 \u672c\u5730 8\u00d7A100 \u8bad\u7ec3\u6210\u672c\u224845 \u4e07\/\u6708\uff0cStarverse GPU \u79df\u8d41\u4ec5 1.2 \u4e07\/\u6708<\/h2>\n

\u661f\u5b87\u667a\u7b97\u56e2\u961f\u5728\u5f00\u6e90\u5f53\u65e5\u4e0a\u5348 10 \u70b9\u7d27\u6025\u4e0a\u67b6\u201cDeepSeek \u4e13\u5c5e\u955c\u50cf\u201d\uff0c\u9884\u88c5 CUDA 12.3\u3001PyTorch 2.3\u3001DeepSpeed-FastGen\u3001Flash-Attention2\uff0c\u5e76\u6253\u901a Hugging Face \u955c\u50cf\u52a0\u901f\u3002\u7528\u6237\u65e0\u9700\u81ea\u5df1\u7f16\u8bd1\uff0c\u4e00\u952e\u5373\u53ef\u8c03\u7528 8\u00d7RTX 4090 GPU \u4e91\u4e3b\u673a<\/strong>\uff0c\u6574\u673a\u6708\u79df\u4f4e\u81f3 1.2 \u4e07\u5143\uff0c\u76f8\u5f53\u4e8e\u4f20\u7edf\u4e91 A100 \u65b9\u6848\u7684 1\/37\u3002<\/p>\n\n\n\n\n\n\n\n\n
\u914d\u7f6e\u5bf9\u6bd4<\/th>\n\u672c\u5730 8\u00d7A100<\/th>\n\u4f20\u7edf\u4e91 A100<\/th>\n\u661f\u5b87 8\u00d74090<\/th>\n<\/tr>\n<\/thead>\n
\u5355\u673a\u5cf0\u503c\u7b97\u529b<\/td>\n624 TF32 TFLOPS<\/td>\n624 TF32 TFLOPS<\/td>\n660 FP16 TFLOPS<\/td>\n<\/tr>\n
\u5185\u5b58\u5e26\u5bbd<\/td>\n2.0 TB\/s<\/td>\n2.0 TB\/s<\/td>\n1.0 TB\/s<\/td>\n<\/tr>\n
\u6708\u79df\u6210\u672c<\/td>\n45 \u4e07+<\/td>\n15 \u4e07<\/td>\n1.2 \u4e07<\/strong><\/td>\n<\/tr>\n
\u8d77\u79df\u65f6\u957f<\/td>\n\u2014<\/td>\n1 \u4e2a\u6708<\/td>\n1 \u5c0f\u65f6<\/strong><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

\u66f4\u91cd\u8981\u7684\u662f\uff0cRTX 4090 \u5728 16-bit \u7cbe\u5ea6\u4e0b\u663e\u5b58\u5360\u7528\u4f18\u5316\u540e\uff0c\u53ef\u7b49\u6548\u66ff\u4ee3 A100 80 G \u7684 70% \u573a\u666f<\/strong>\uff0c\u800c\u4ef7\u683c\u5374\u4e0d\u5230\u540e\u8005\u7684 3%\u3002\u5bf9\u4e8e\u9884\u7b97\u6709\u9650\u7684\u9ad8\u6821\u5b9e\u9a8c\u5ba4\u4e0e\u521d\u521b\u516c\u53f8\uff0c\u8fd9\u610f\u5473\u7740\u201c\u5343\u4ebf\u53c2\u6570\u201d\u4e0d\u518d\u662f\u5de8\u5934\u4e13\u5229\u3002<\/p>\n

\n

\u2462 \u5e73\u53f0\u5185\u7f6e\u6570\u636e\u96c6+\u6a21\u578b\u5e76\u884c\u811a\u672c\uff0c30 \u5206\u949f\u62c9\u8d77\u8bad\u7ec3<\/h2>\n

\u661f\u5b87\u667a\u7b97\u628a\u201cAI \u5e94\u7528\u201d\u505a\u6210\u50cf\u5f00\u865a\u62df\u673a\u4e00\u6837\u7b80\u5355\uff1a<\/p>\n

    \n
  1. \u767b\u5f55\u63a7\u5236\u53f0 \u2192 \u9009\u62e9\u201cDeepSeek-R1 \u4e00\u952e\u8bad\u7ec3\u201d\u6a21\u677f <\/li>\n
  2. \u6302\u8f7d\u5e73\u53f0\u5185\u7f6e\u7684 2T \u7cbe\u8c03\u8bed\u6599\uff08\u5df2\u505a\u53bb\u91cd\u3001NSFW \u8fc7\u6ee4\u3001CC \u534f\u8bae\u5408\u89c4\uff09 <\/li>\n
  3. \u70b9\u51fb\u201c\u542f\u52a8\u8bad\u7ec3\u201d \u2192 \u7cfb\u7edf\u81ea\u52a8\u62c6\u5206\u6a21\u578b\u5e76\u884c\u3001\u4f18\u5316\u5668\u72b6\u6001\u3001\u68af\u5ea6\u5206\u7247\uff0c30 \u5206\u949f\u5185\u5373\u53ef\u89c2\u6d4b\u5230 loss \u4e0b\u964d\u66f2\u7ebf<\/li>\n<\/ol>\n

    \u6574\u4e2a\u6d41\u7a0b\u96f6\u4ee3\u7801<\/strong>\uff0c\u5374\u4fdd\u7559 DeepSpeed \u7684\u5168\u90e8\u9ad8\u7ea7\u53c2\u6570\uff0c\u9ad8\u7ea7\u73a9\u5bb6\u4ecd\u53ef\u81ea\u5b9a\u4e49 zero_stage<\/code>\u3001offload_ratio<\/code> \u7b49\u5b57\u6bb5\u3002\u5e73\u53f0\u540c\u65f6\u63d0\u4f9b TensorBoard \u4e0e WandB \u53cc\u901a\u9053\u5b9e\u65f6\u76d1\u63a7\uff0c\u624b\u673a\u7aef\u4e5f\u80fd\u968f\u65f6\u67e5\u770b GPU \u5229\u7528\u7387\u3002<\/p>\n

    \n

    \u2463 \u6027\u80fd\u57fa\u51c6\uff1a\u5e73\u5747 1.7\u00d7 \u63d0\u901f vs \u4f20\u7edf\u4e91<\/h2>\n

    \u4e3a\u4e86\u9a8c\u8bc1\u201c\u4fbf\u5b9c\u662f\u5426\u7b49\u4e8e\u6162\u201d\uff0c\u661f\u5b87\u667a\u7b97\u8054\u5408\u72ec\u7acb\u8bc4\u6d4b\u673a\u6784 AIProbe\uff0c\u5bf9\u6bd4\u4e86\u540c\u6837 8 \u5361\u73af\u5883\u4e0b\u7684 175B \u6a21\u578b\u5fae\u8c03\u4efb\u52a1\uff08Global Batch=2048\uff0cSeq Len=4096\uff0cSteps=1000\uff09\uff1a<\/p>\n\n\n\n\n\n\n\n\n
    \u6307\u6807<\/th>\n\u4f20\u7edf\u4e91 A100<\/th>\n\u661f\u5b87 4090<\/th>\n\u63d0\u5347<\/th>\n<\/tr>\n<\/thead>\n
    \u5e73\u5747\u8fed\u4ee3\u65f6\u95f4<\/td>\n38.6 s<\/td>\n22.7 s<\/td>\n1.7\u00d7<\/strong><\/td>\n<\/tr>\n
    \u6bcf\u6b65\u663e\u5b58\u5cf0\u503c<\/td>\n78 G<\/td>\n79 G<\/td>\n\u6301\u5e73<\/td>\n<\/tr>\n
    \u8bad\u7ec3\u7a33\u5b9a\u6027<\/td>\n2 \u6b21 NCCL \u8d85\u65f6<\/td>\n0 \u6b21<\/td>\n100% \u7a33\u5b9a<\/strong><\/td>\n<\/tr>\n
    \u6210\u672c\/\u6b65<\/td>\n0.89 \u5143<\/td>\n0.05 \u5143<\/td>\n17\u00d7 \u8282\u7701<\/strong><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

    \u63d0\u901f\u79d8\u8bc0\u5728\u4e8e\u4e24\u70b9\uff1a
    \n1. \u661f\u5b87\u81ea\u7814\u7684 StarLink<\/code> RDMA \u7f51\u7edc\uff0c\u5ef6\u8fdf\u4f4e\u4e8e 2 \u03bcs\uff0c\u5e26\u5bbd 200 Gbps\uff0c\u8ba9 4090 \u4e5f\u80fd\u8dd1\u901a\u5343\u4ebf\u53c2\u6570 ZeRO-3<\/strong>\uff1b
    \n2. \u72ec\u5bb6\u5185\u6838\u7ea7 CUDA Graph \u4f18\u5316\uff0c\u628a PyTorch \u7684 Python \u8c03\u5ea6\u5f00\u9500\u964d\u5230 0.3 ms \u4ee5\u4e0b\uff0c\u5355\u5361\u7b97\u529b\u69a8\u5e72\u7387\u63d0\u5347\u81f3 97%<\/strong>\u3002<\/p>\n

    \n

    \u2464 \u6559\u7a0b\uff1a\u4e09\u6b65\u5b8c\u6210\u6570\u636e\u4e0a\u4f20\u2192\u8bad\u7ec3\u2192\u63a8\u7406\u90e8\u7f72<\/h2>\n

    Step 1\uff1a\u6570\u636e\u4e0a\u4f20<\/strong>
    \n– \u63a7\u5236\u53f0\u5de6\u4fa7\u8fdb\u5165\u201c\u5bf9\u8c61\u5b58\u50a8\u201d\uff0c\u65b0\u5efa deepseek-project<\/code> \u6876
    \n– \u652f\u6301 Web\u3001S3 API\u3001Rclone \u4e09\u901a\u9053\uff0c10 GB \u5185\u514d\u8d39<\/strong>
    \n– \u82e5\u4f7f\u7528\u5e73\u53f0\u5185\u7f6e\u8bed\u6599\uff0c\u53ef\u8df3\u8fc7\u6b64\u6b65<\/p>\n

    Step 2\uff1a\u542f\u52a8\u8bad\u7ec3<\/strong>
    \n– \u9009\u62e9 GPU\u670d\u52a1\u5668\u79df\u7528 \u89c4\u683c\uff1a8\u00d74090\/24 G\uff0c\u6309\u5c0f\u65f6\u8ba1\u8d39
    \n– \u955c\u50cf\u9009\u62e9 \u201cDeepSeek-R1-175B-Full-FineTune\u201d
    \n– \u586b\u5199 learning_rate=2e-5<\/code>\u3001warmup_steps=200<\/code>\uff0c\u70b9\u51fb\u201c\u521b\u5efa\u201d
    \n– \u5e73\u5747 27 \u5206\u949f\u540e\uff0ccheckpoint \u81ea\u52a8\u8f6c\u5b58\u81f3\u60a8\u7684\u6301\u4e45\u5316\u4e91\u76d8<\/p>\n

    Step 3\uff1a\u63a8\u7406\u90e8\u7f72<\/strong>
    \n– \u8bad\u7ec3\u7ed3\u675f \u2192 \u4e00\u952e\u5bfc\u51fa hf_format<\/code> \u6743\u91cd
    \n– \u8fdb\u5165\u201cAI \u5e94\u7528\u201d\u5e02\u573a\uff0c\u9009\u62e9 \u201cTGI-2.0 \u9ad8\u901f\u63a8\u7406\u201d
    \n– \u4e0b\u62c9\u9009\u62e9\u521a\u521a\u5bfc\u51fa\u7684\u6743\u91cd \u2192 \u7cfb\u7edf\u81ea\u52a8\u5206\u914d 4\u00d74090 \u63a8\u7406\u8282\u70b9
    \n– \u83b7\u5f97 80 \u5e76\u53d1\u30012200 tokens\/s<\/strong> \u7684 API \u7f51\u5173\u5730\u5740\uff0c\u53ef\u76f4\u63a5\u63a5\u5165\u4e1a\u52a1<\/p>\n

    \n

    \u5f69\u86cb\uff1a\u65b0\u7528\u6237\u6ce8\u518c\u5373\u9001 10 \u5143\u4f53\u9a8c\u91d1<\/h2>\n

    \u73b0\u5728\u901a\u8fc7\u5b98\u7f51\u6ce8\u518c<\/a>\uff0c\u5b8c\u6210\u5b9e\u540d\u8ba4\u8bc1\u5373\u53ef\u5230\u8d26 10 \u5143\uff0c\u8db3\u591f\u514d\u8d39\u8dd1\u901a 1.3B \u6a21\u578b\u5b8c\u6574\u5fae\u8c03\u6d41\u7a0b<\/strong>\u3002\u9080\u8bf7\u597d\u53cb\u518d\u5f97 20 \u5143\uff0c\u4e0a\u4e0d\u5c01\u9876\u3002\u65e0\u8bba\u4f60\u662f\u9ad8\u6821\u8bfe\u9898\u7ec4\u3001\u72ec\u7acb\u5f00\u53d1\u8005\uff0c\u8fd8\u662f\u6b63\u5728\u627e\u201c\u7b2c\u4e8c\u6735\u4e91\u201d\u505a\u5bb9\u707e\u7684 CTO\uff0c\u661f\u5b87\u667a\u7b97\u90fd\u51c6\u5907\u597d\u4e86\u8db3\u591f\u7684 GPU\u4e91\u4e3b\u673a<\/a> \u4e0e\u5de5\u7a0b\u5e08 7\u00d724 \u503c\u5b88\uff0c\u8ba9\u7b97\u529b\u4e0d\u518d\u6210\u4e3a\u521b\u65b0\u7684\u5929\u82b1\u677f\u3002<\/p>\n

    DeepSeek-R1 \u5df2\u7ecf\u5f00\u6e90\uff0c\u4e0b\u4e00\u4e2a\u98a0\u8986\u4e16\u754c\u7684\u6a21\u578b\uff0c\u4e5f\u8bb8\u5c31\u5728\u4f60\u7684\u6307\u5c16\u3002<\/p>\n","protected":false},"excerpt":{"rendered":"

    DeepSeek-R1 \u5f00\u6e90\u540e 48 \u5c0f\u65f6\uff0c\u661f\u5b87\u667a\u7b97\u5e73\u53f0\u4f4e\u6210…<\/p>\n","protected":false},"author":2,"featured_media":2584,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-2585","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-zixun"],"views":62,"_links":{"self":[{"href":"https:\/\/www.starverse-ai.com\/guide\/wp-json\/wp\/v2\/posts\/2585","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.starverse-ai.com\/guide\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.starverse-ai.com\/guide\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.starverse-ai.com\/guide\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.starverse-ai.com\/guide\/wp-json\/wp\/v2\/comments?post=2585"}],"version-history":[{"count":0,"href":"https:\/\/www.starverse-ai.com\/guide\/wp-json\/wp\/v2\/posts\/2585\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.starverse-ai.com\/guide\/wp-json\/wp\/v2\/media\/2584"}],"wp:attachment":[{"href":"https:\/\/www.starverse-ai.com\/guide\/wp-json\/wp\/v2\/media?parent=2585"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.starverse-ai.com\/guide\/wp-json\/wp\/v2\/categories?post=2585"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.starverse-ai.com\/guide\/wp-json\/wp\/v2\/tags?post=2585"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}