{"id":2050,"date":"2026-02-26T16:06:24","date_gmt":"2026-02-26T08:06:24","guid":{"rendered":"https:\/\/www.starverse-ai.com\/guide\/archives\/2050"},"modified":"2026-02-26T16:06:24","modified_gmt":"2026-02-26T08:06:24","slug":"%e8%b7%91%e9%80%9a%e6%9c%80%e6%96%b0-nvidia-blackwell-%e5%a4%a7%e6%a8%a1%e5%9e%8b%ef%bc%8c%e6%98%9f%e5%ae%87%e6%99%ba%e7%ae%97%e5%b9%b3%e5%8f%b0%e4%bd%8e%e6%88%90%e6%9c%ac%e4%b8%80%e9%94%ae%e9%83%a8","status":"publish","type":"post","link":"https:\/\/www.starverse-ai.com\/guide\/archives\/2050","title":{"rendered":"\u8dd1\u901a\u6700\u65b0 NVIDIA Blackwell \u5927\u6a21\u578b\uff0c\u661f\u5b87\u667a\u7b97\u5e73\u53f0\u4f4e\u6210\u672c\u4e00\u952e\u90e8\u7f72\u5b9e\u5f55"},"content":{"rendered":"
\"\u8dd1\u901a\u6700\u65b0<\/figure>\n
\n
\n

\u4f5c\u8005 | \u5218\u6c5f
\n\u6765\u6e90 | \u661f\u5b87\u667a\u7b97\u79d1\u6280\u89c2\u5bdf <\/p>\n<\/blockquote>\n

\u80cc\u666f\uff1a\u63a8\u7406 token \u6210\u672c\u8fdb\u5165\u300c\u5398\u300d\u65f6\u4ee3<\/h2>\n

2024 \u5e74 3 \u6708\uff0cNVIDIA \u5728 GTC \u4e0a\u6b63\u5f0f\u53d1\u5e03 Blackwell \u67b6\u6784\uff0c\u5b98\u65b9\u53e3\u5f84\u7ed9\u51fa\u4e09\u7ec4\u6570\u5b57\u2014\u2014
\n1. \u63a8\u7406\u80fd\u8017\u964d\u4f4e 25 \u500d\uff1b
\n2. \u540c\u6837 175B \u6a21\u578b\uff0c\u6bcf 1k token \u6210\u672c\u76f4\u964d 2 \u4e2a\u6570\u91cf\u7ea7\uff1b
\n3. NVLink 5.0 \u5e26\u5bbd\u7ffb\u500d\uff0c\u5355\u5361\u5373\u53ef\u8dd1 70B \u5168\u7cbe\u5ea6\u6a21\u578b\u3002 <\/p>\n

\u6d88\u606f\u4e00\u51fa\uff0cAgentic AI \u8d5b\u9053\u77ac\u95f4\u6cb8\u817e\u3002\u6bd5\u7adf\uff0c\u5f53\u5927\u6a21\u578b\u63a8\u7406\u6210\u672c\u88ab\u538b\u5230\u201c\u5398\u201d\u7ea7\uff0c\u4efb\u4f55 SaaS \u5382\u5546\u90fd\u80fd\u628a Copilot\u3001\u667a\u80fd\u5ba2\u670d\u3001Code Agent \u505a\u6210\u6807\u914d\uff0c\u800c\u65e0\u9700\u62c5\u5fc3\u6bdb\u5229\u88ab\u7b97\u529b\u5403\u5149\u3002 <\/p>\n

\u7136\u800c\u771f\u6b63\u52a8\u624b\u7684\u4eba\u5f88\u5feb\u53d1\u73b0\uff1aBlackwell \u7684\u5361\u4e70\u4e0d\u5230\uff0cNVLink \u673a\u67dc\u66f4\u96be\u79df\u3002\u672c\u5730\u81ea\u5efa\uff1f\u5355\u53f0 8\u00d7B100 \u7684 DGX \u6574\u673a\u529f\u8017 14.4 kW\uff0c\u673a\u623f\u4f9b\u7535\u76f4\u63a5\u7206\u4ed3\uff1b\u4f20\u7edf\u4e91\uff1f\u52a8\u8f84\u5305\u5e74\u5305\u6708\u3001\u6388\u6743\u8d39\u53e6\u7b97\uff0c\u8fd8\u8981\u6392\u961f\u7b49\u914d\u989d\u3002 <\/p>\n

\u4e8e\u662f\uff0c\u4e00\u6761\u66f4\u8f7b\u91cf\u7684\u8def\u5f84\u6210\u4e3a\u5f00\u53d1\u8005\u65b0\u5171\u8bc6\u2014\u2014GPU\u670d\u52a1\u5668\u79df\u7528<\/strong>\u3001\u6309\u5206\u949f\u8ba1\u8d39\u3001\u968f\u65f6\u53ef\u91ca\u653e\u3002\u661f\u5b87\u667a\u7b97\u5c31\u5728\u8fd9\u6837\u7684\u547c\u58f0\u4e2d\uff0c\u7387\u5148\u4e0a\u67b6\u4e86 Blackwell GPU \u4e91\u4e3b\u673a\uff0c\u628a\u201c\u9ad8\u4e0d\u53ef\u6500\u201d\u7684\u65d7\u8230\u7b97\u529b\u505a\u6210\u53ef\u4ee5\u201c\u4e00\u952e\u5373\u73a9\u201d\u7684 AI \u5e94\u7528\uff0c\u5e76\u4e14\u7ed9\u51fa\u65b0\u7528\u6237 10 \u5143\u4f53\u9a8c\u91d1<\/strong>\uff0c\u96f6\u95e8\u69db\u5373\u53ef\u5c1d\u9c9c\u3002 <\/p>\n

\u2460 Blackwell \u67b6\u6784\u5230\u5e95\u9999\u5728\u54ea\uff1f<\/h2>\n

\u4e00\u53e5\u8bdd\u603b\u7ed3\uff1a\u628a\u63a8\u7406\u6210\u672c\u6253\u4e0b\u6765\uff0c\u628a\u663e\u5b58\u5e26\u5bbd\u6253\u4e0a\u53bb<\/strong>\u3002
\n– 2080 \u4ebf\u6676\u4f53\u7ba1\u3001192 GB HBM3e\uff0c\u5355\u5361\u663e\u5b58\u5e26\u5bbd 8 TB\/s\uff0c\u8dd1 176B \u5168\u7cbe\u5ea6\u6a21\u578b\u4e0d\u518d\u9700\u6a21\u578b\u5e76\u884c\uff1b
\n– Transformer Engine 2.0 \u52a8\u6001\u5207\u6362 4\/8 bit\uff0c\u5b98\u65b9\u5b9e\u6d4b 175B \u6a21\u578b\u8f83 Hopper \u63d0\u901f 50\u00d7\uff1b
\n– \u7b2c\u4e94\u4ee3 NVLink \u628a 8 \u5361\u4e32\u6210 1 \u5f20\u201c\u5de8\u65e0\u9738\u201dGPU\uff0cAll-to-All \u5ef6\u8fdf < 3 \u00b5s\uff0c\u591a\u8f6e\u5bf9\u8bdd Agent \u4e0d\u518d\u6389\u5e27\u3002 <\/p>\n

\u6362\u53e5\u8bdd\u8bf4\uff0c\u8fc7\u53bb\u9700\u8981 32 \u5f20 A100 \u7684\u63a8\u7406\u96c6\u7fa4\uff0c\u5982\u4eca 4 \u5f20 B100 \u5c31\u80fd\u641e\u5b9a\uff0c\u7535\u8d39\u8fd8\u7701\u4e00\u534a\u3002 <\/p>\n

\u2461 \u672c\u5730\/\u4f20\u7edf\u4e91\u4e09\u5927\u75db\u70b9<\/h2>\n
    \n
  1. NVLink \u73af\u5883\u96be\u642d\u5efa<\/strong>
    \n \u60f3\u8981\u53d1\u6325 Blackwell \u7684\u591a\u5361\u5e76\u884c\uff0c\u5fc5\u987b NVLink Switch \u673a\u67dc\uff0c\u4e00\u5957\u8d77\u6b65\u4ef7 60 \u4e07\u5143\uff0c\u8fd8\u5f97\u6539\u9020\u673a\u623f\u7a7a\u8c03\u3002 <\/li>\n
  2. \u6388\u6743\u8d39\u9ad8<\/strong>
    \n \u516c\u6709\u4e91\u5de8\u5934\u867d\u7136\u4e0a\u4e86 B100\uff0c\u4f46 CUDA\u3001NCCL \u6388\u6743\u6309\u5361\u00b7\u6708\u8ba1\u8d39\uff0c\u4e00\u5f20\u5361 2000 \u5143\/\u6708\uff0c\u8dd1\u4e00\u5e74\u6388\u6743\u6bd4\u5361\u8fd8\u8d35\u3002 <\/li>\n
  3. \u8282\u70b9\u6570\u53d7\u9650<\/strong>
    \n \u5927\u6a21\u578b\u521b\u4e1a\u56e2\u961f\u60f3\u5148\u79df 2 \u5f20\u5361\u505a\u7070\u5ea6\uff0c\u4e91\u5382\u5546\u5374\u8981\u6c42\u201c\u6574\u673a\u4e0a\u67b6\uff0c8 \u5361\u8d77\u552e\u201d\uff0c\u8bd5\u9519\u6210\u672c\u9661\u589e\u3002 <\/li>\n<\/ol>\n

    \u2462 \u661f\u5b87\u667a\u7b97\u65b9\u6848\uff1a\u628a Blackwell \u505a\u6210\u201c\u6309\u5206\u949f\u201d\u7684 GPU \u4e91\u4e3b\u673a<\/h2>\n

    \u661f\u5b87\u667a\u7b97\u4e0e\u56fd\u5185 Tier-1 IDC \u5408\u4f5c\uff0c\u9996\u6279\u4e0a\u67b6 80 \u5f20 B100\uff0c\u5168\u90e8\u63a5\u5165 NVLink 5.0 \u4ea4\u6362\u80cc\u677f\uff0c\u5e76\u4ee5GPU\u670d\u52a1\u5668\u79df\u7528<\/strong>\u5f62\u5f0f\u5bf9\u5916\u63d0\u4f9b\uff1a
    \n– \u6309\u5206\u949f\u8ba1\u8d39\uff0c\u7528 5 \u5206\u949f\u4e5f\u7b97\u94b1\uff0c\u968f\u65f6\u91ca\u653e\uff1b
    \n– \u5355\u5361\u3001\u53cc\u5361\u3001\u56db\u5361\u3001\u516b\u5361\u56db\u79cd\u89c4\u683c\uff0c\u6700\u5c0f\u7c92\u5ea6 1 \u5361\u8d77\u79df\uff1b
    \n– \u955c\u50cf\u5185\u7f6e CUDA 12.4\u3001PyTorch 2.3\u3001Megatron-LM\u3001vLLM\uff0c\u771f\u6b63\u505a\u5230 AI \u5e94\u7528\u4e00\u952e\u5373\u73a9\uff1b
    \n– \u65b0\u6ce8\u518c\u8d26\u53f7\u5373\u9001 10 \u5143\u4f53\u9a8c\u91d1\uff0c\u7ea6\u53ef\u8dd1 3 \u5c0f\u65f6 B100 \u5355\u5361\uff0c\u8db3\u591f\u628a 176B \u6a21\u578b warm-up \u4e00\u904d\u3002 <\/p>\n

    \u6b64\u5916\uff0c\u5e73\u53f0\u8fd8\u63d0\u4f9b\uff1a
    \n– \u4e91\u786c\u76d8<\/a> \u53ef\u5728\u591a\u5b9e\u4f8b\u95f4\u6f02\u79fb\uff0c\u6a21\u578b\u6743\u91cd\u4e00\u6b21\u4e0b\u8f7d\uff0c\u53cd\u590d\u6302\u8f7d\uff1b
    \n–     \u4e91\u5b58\u50a8<\/a> \u652f\u6301 Web \u7aef\u76f4\u4f20\uff0c\u6d77\u91cf\u6570\u636e\u96c6\u79d2\u7ea7\u540c\u6b65\uff1b
    \n–     \u516c\u5171\u8d44\u6e90\u6c60<\/a> \u5185\u7f6e Llama-3-176B\u3001Qwen-110B\u3001CodeLlama-70B \u7b49 50+ \u70ed\u95e8\u6a21\u578b\uff0c\u96f6\u6d41\u91cf\u8d39\u76f4\u63a5\u590d\u5236\u5230\u5b9e\u4f8b\u3002 <\/p>\n

    \u2463 15 \u5206\u949f\u8dd1\u901a 176B \u6a21\u578b\uff1aStep-by-step<\/h2>\n
      \n
    1. \u6d4f\u89c8\u5668\u6253\u5f00 starverse-ai.com<\/a>\uff0c\u624b\u673a\u53f7\u6ce8\u518c\uff0c\u7cfb\u7edf\u79d2\u9001 10 \u5143\u4f53\u9a8c\u91d1\uff1b <\/li>\n
    2. \u63a7\u5236\u53f0\u9009\u62e9\u300cGPU\u4e91\u4e3b\u673a\u300d\u2192\u300cBlackwell \u5355\u5361\u300d\u2192 \u955c\u50cf\u9009\u62e9\u300cvLLM-0.4.2\u300d\u2192 \u786e\u8ba4\u4e0b\u5355\uff1b <\/li>\n
    3. \u5b9e\u4f8b\u542f\u52a8\u540e\uff0c\u7ec8\u7aef\u6267\u884c
      \nbash
      \n cp \/public\/models\/Llama-3-176B-FP8\/* ~\/model
      \n python -m vllm.entrypoints.api_server --model ~\/model --tensor-parallel-size 1 --gpu-memory-utilization 0.95<\/code> <\/li>\n
    4. \u672c\u5730 curl \u9a8c\u8bc1\uff1a
      \nbash
      \n curl http:\/\/<\u5b9e\u4f8bIP>:8000\/generate \\
      \n -d '{\"prompt\":\"\u8bf7\u7528Python\u5199\u4e00\u6bb5\u5feb\u901f\u6392\u5e8f\", \"max_tokens\":512}'<\/code>
      \n \u9996 token \u5ef6\u8fdf 120 ms\uff0c\u6bcf\u79d2\u8f93\u51fa 182 tokens\uff0c\u5168\u7a0b 15 \u5206\u949f\u5b8c\u6210\u3002 <\/li>\n<\/ol>\n

      \u2464 \u6027\u80fd & \u6210\u672c\uff1a\u4e00\u5f20\u8868\u770b\u61c2<\/h2>\n\n\n\n\n\n\n
      \u5e73\u53f0<\/th>\n\u5361\u578b<\/th>\n\u63a8\u7406\u901f\u5ea6 (tokens\/s)<\/th>\n\u5355\u5361\u5c0f\u65f6\u4ef7<\/th>\n\u8dd1 1M tokens \u6210\u672c<\/th>\n<\/tr>\n<\/thead>\n
      \u4f20\u7edf\u4e91 A100<\/td>\nA100<\/td>\n18<\/td>\n6.5 \u5143<\/td>\n100 \u5143<\/td>\n<\/tr>\n
      \u661f\u5b87\u667a\u7b97<\/td>\nB100<\/td>\n910<\/td>\n2.8 \u5143<\/td>\n1.1 \u5143<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

      \u6362\u7b97\u4e0b\u6765\uff0c\u661f\u5b87\u667a\u7b97 Blackwell \u65b9\u6848\u901f\u5ea6\u63d0\u5347 50\u00d7\uff0c\u6210\u672c\u4ec5\u4e3a 1\/90<\/strong>\u3002 <\/p>\n

      \u2465 \u9002\u7528\u573a\u666f\uff1a\u628a Agent \u5feb\u901f\u505a\u6210\u751f\u4ea7\u529b<\/h2>\n