{"id":3167,"date":"2026-03-11T14:09:41","date_gmt":"2026-03-11T06:09:41","guid":{"rendered":"https:\/\/www.starverse-ai.com\/guide\/archives\/3167"},"modified":"2026-03-11T14:09:41","modified_gmt":"2026-03-11T06:09:41","slug":"%e8%87%aa%e8%b4%ad-8-%e5%8d%a1-a100-%e8%8a%b1-120-%e4%b8%87%ef%bc%9f%e4%b8%80%e5%bc%a0%e6%88%90%e6%9c%ac%e5%af%b9%e6%af%94%e8%a1%a8%e7%9c%8b%e6%87%82%e6%98%9f%e5%ae%87%e6%99%ba%e7%ae%97-gpu","status":"publish","type":"post","link":"https:\/\/www.starverse-ai.com\/guide\/archives\/3167","title":{"rendered":"\u81ea\u8d2d 8 \u5361 A100 \u82b1 120 \u4e07\uff1f\u4e00\u5f20\u6210\u672c\u5bf9\u6bd4\u8868\u770b\u61c2\u201c\u661f\u5b87\u667a\u7b97 GPU \u79df\u8d41\u201d\u5982\u4f55\u7701\u51fa 3 \u540d\u7b97\u6cd5\u5de5\u7a0b\u5e08\u5e74\u85aa"},"content":{"rendered":"
\"\u81ea\u8d2d<\/figure>\n

\u81ea\u8d2d 8 \u5361 A100 \u82b1 120 \u4e07\uff1f\u4e00\u5f20\u6210\u672c\u5bf9\u6bd4\u8868\u770b\u61c2\u201c\u661f\u5b87\u667a\u7b97 GPU \u79df\u8d41\u201d\u5982\u4f55\u7701\u51fa 3 \u540d\u7b97\u6cd5\u5de5\u7a0b\u5e08\u5e74\u85aa<\/h1>\n
\n

30%\uff0c\u8fd9\u662f\u8fc7\u53bb 6 \u4e2a\u6708 NVIDIA A100 \u7684\u73b0\u8d27\u6da8\u5e45\u3002
\n\u201c\u9884\u7b97\u780d 40%\uff0c\u9879\u76ee\u7167\u8dd1\u3002\u201d\u2014\u2014\u5f53 CFO \u628a\u8fd9\u53e5\u8bdd\u7529\u7ed9 CTO\uff0cAI \u56e2\u961f\u8981\u4e48\u88c1\u5458\uff0c\u8981\u4e48\u6362\u7b97\u529b\u3002 <\/p>\n<\/blockquote>\n

01 \u663e\u5361\u6da8\u4ef7 30%\uff0cAI \u9884\u7b97\u88ab\u9501\u5589<\/h2>\n

IDC \u6700\u65b0\u62a5\u544a\u663e\u793a\uff0c2024 Q1 \u56fd\u5185 AI \u670d\u52a1\u5668\u4ea4\u4ed8\u5468\u671f\u5df2\u62c9\u957f\u5230 14 \u5468\uff0c\u5e73\u5747\u6ea2\u4ef7 30%\u3002
\n\u66f4\u9ebb\u70e6\u7684\u662f\u7535\u8d39\uff1a\u5de5\u4e1a\u7528\u7535\u8fdb\u5165\u9636\u68af\u8ba1\u4ef7\u540e\uff0c\u534e\u5317\u3001\u534e\u5357\u4e24\u5927 AI \u96c6\u7fa4\u57ce\u5e02 12 \u4e2a\u6708\u7535\u8d39\u4e0a\u6da8 18%\u3002
\n\u786c\u4ef6\u3001\u7535\u8d39\u3001\u8fd0\u7ef4\u3001\u95f2\u7f6e\uff0c\u6bcf\u4e00\u5200\u90fd\u780d\u5728 CFO \u6700\u5728\u610f\u7684 TCO\uff08Total Cost of Ownership\uff09\u3002
\n\u4e8e\u662f\uff0c\u8d8a\u6765\u8d8a\u591a\u6280\u672f\u8d1f\u8d23\u4eba\u628a\u89c6\u7ebf\u4ece\u201c\u4e70\u65ad\u201d\u8f6c\u5411\u201cGPU\u670d\u52a1\u5668\u79df\u7528<\/a>\u201d\u2014\u2014\u7528\u591a\u5c11\u82b1\u591a\u5c11\uff0c\u8ba9\u73b0\u91d1\u6d41\u56de\u5230\u5b89\u5168\u533a\u3002<\/p>\n

02 \u4e00\u5f20\u8868\u770b\u61c2 8 \u5361 A100 \u7684\u4e09\u5e74\u8d26<\/h2>\n

\u4ee5\u4e0b\u6570\u636e\u6765\u81ea 15 \u5bb6\u4e0a\u5e02 AI \u516c\u53f8\u516c\u5f00\u8d22\u62a5\uff0b\u661f\u5b87\u667a\u7b97 4000 \u5bb6\u5ba2\u6237\u6837\u672c\uff0c\u7edf\u4e00\u6298\u7b97 8 \u5361 A100\u3001365\u00d724h \u6ee1\u8f7d\u3001PUE=1.25\u3001\u5de5\u4e1a\u7535\u4ef7 0.85 \u5143\/kWh\u3002<\/p>\n\n\n\n\n\n\n\n\n\n\n\n\n
\u6210\u672c\u9879<\/th>\n\u81ea\u5efa IDC\uff08\u4e00\u6b21\u6027\uff09<\/th>\n\u661f\u5b87\u667a\u7b97 GPU \u79df\u8d41\uff08\u6309\u9700\uff09<\/th>\n<\/tr>\n<\/thead>\n
\u786c\u4ef6\u91c7\u8d2d<\/td>\n120 \u4e07\uff088\u00d7A100 80G\uff09<\/td>\n0 \u5143<\/td>\n<\/tr>\n
\u673a\u623f\u6298\u65e7<\/td>\n3 \u5e74 40 \u4e07<\/td>\n0 \u5143<\/td>\n<\/tr>\n
\u7535\u8d39<\/td>\n3 \u5e74 45 \u4e07<\/td>\n0 \u5143<\/td>\n<\/tr>\n
\u8fd0\u7ef4\u4eba\u529b\uff082 \u540d DevOps\uff09<\/td>\n3 \u5e74 108 \u4e07<\/td>\n0 \u5143<\/td>\n<\/tr>\n
\u95f2\u7f6e\u7387 25% \u6c89\u6ca1<\/td>\n3 \u5e74 30 \u4e07<\/td>\n0 \u5143<\/td>\n<\/tr>\n
\u5e73\u53f0\u5de5\u5177\uff08\u6570\u636e\u3001\u6a21\u578b\u3001\u5feb\u7167\uff09<\/td>\n\u81ea\u5efa 20 \u4e07<\/td>\n\u514d\u8d39<\/td>\n<\/tr>\n
\u4e09\u5e74\u5408\u8ba1<\/strong><\/td>\n363 \u4e07<\/strong><\/td>\n281 \u4e07<\/strong><\/td>\n<\/tr>\n
\u8282\u7701<\/strong><\/td>\n\u2014<\/td>\n82 \u4e07<\/strong><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n
\n

82 \u4e07 \u2248 \u4e09\u540d\u7b97\u6cd5\u5de5\u7a0b\u5e08\u5e74\u85aa\u3002\u6216\u8005\uff0c\u8db3\u591f\u628a 0.7B \u6a21\u578b\u7ee7\u7eed\u9884\u8bad\u7ec3\u5230 7B\u3002<\/p>\n<\/blockquote>\n

03 \u4e3a\u4ec0\u4e48\u80fd\u7701 82 \u4e07\uff1f\u62c6\u5f00\u6765\u770b<\/h2>\n
    \n
  1. \n

    \u786c\u4ef6\u6298\u65e7\u5f52\u96f6<\/strong>
    \n \u4e70\u65ad 8 \u5361 A100\uff0c\u7b2c 2 \u5e74\u6b8b\u503c\u53ea\u5269 55%\uff0c\u7b2c 3 \u5e74\u4f4e\u81f3 30%\u3002\u800cGPU\u4e91\u4e3b\u673a<\/a>\u628a\u6298\u65e7\u98ce\u9669\u8f6c\u5ac1\u7ed9\u5e73\u53f0\uff0c\u7528\u6237\u6309\u5c0f\u65f6\u8ba1\u8d39\uff0c\u968f\u65f6\u5347\u964d\u914d\u7f6e\u3002<\/p>\n<\/li>\n

  2. \n

    \u7535\u8d39\u9690\u5f62\u6740\u624b<\/strong>
    \n A100 \u5355\u5361 TDP 400 W\uff0c8 \u5361\uff0b\u670d\u52a1\u5668 overhead \u5168\u5e74\u8017\u7535 35 MWh\uff0c\u7535\u8d39 30 \u4e07\u8d77\u6b65\u3002\u661f\u5b87\u667a\u7b97\u81ea\u5efa\u7eff\u8272\u673a\u623f\uff0c\u6279\u53d1\u7535\u4ef7 + \u6db2\u51b7\u65b9\u6848\uff0c\u6210\u672c\u7aef\u5df2\u644a\u8584\uff0c\u7528\u6237\u65e0\u9700\u5355\u72ec\u7ed3\u7b97\u3002<\/p>\n<\/li>\n

  3. \n

    \u8fd0\u7ef4\u4eba\u529b\u780d\u6389 2 \u540d DevOps<\/strong>
    \n \u81ea\u5efa\u65b9\u6848\u9700\u8981 24 h \u503c\u73ed\uff1aNVLink \u6545\u969c\u3001CUDA \u7248\u672c\u5347\u7ea7\u3001RDMA \u7f51\u7edc\u4e22\u5305\u2026\u2026\u661f\u5b87\u667a\u7b97\u5e73\u53f0\u628a\u5e95\u5c42\u5c01\u88c5\u6210 30 \u79d2\u4ea4\u4ed8\u7684\u201c\u767d\u76d2\u201d\uff0c\u5185\u7f6e\u955c\u50cf\u3001\u5feb\u7167\u3001\u6545\u969c\u8fc1\u79fb\uff0c\u7b97\u6cd5\u5de5\u7a0b\u5e08\u81ea\u5df1\u5c31\u80fd\u91cd\u542f\u5b9e\u4f8b\u3002<\/p>\n<\/li>\n

  4. \n

    \u95f2\u7f6e\u7387 25% \u76f4\u63a5\u62b9\u5e73<\/strong>
    \n \u4e1a\u52a1\u9ad8\u5cf0\u901a\u5e38\u5728\u6708\u521d\u6216\u7248\u672c\u53d1\u5e03\u5f53\u5468\uff0c\u5176\u4f59\u65f6\u95f4 GPU \u7a7a\u8f6c\u3002\u79df\u8d41\u6a21\u5f0f\u652f\u6301\u201c\u8dd1\u5b8c\u5c31\u91ca\u653e\u201d\uff0c\u5b9e\u6d4b\u5ba2\u6237\u5e73\u5747\u95f2\u7f6e\u7387 <5%\uff0c\u76f8\u5f53\u4e8e\u53c8\u7701\u51fa 5 \u5f20\u663e\u5361\u3002<\/p>\n<\/li>\n<\/ol>\n

    04 \u7701\u4e0b\u7684\u4e0d\u53ea\u662f\u94b1\uff0c\u8fd8\u6709\u8fed\u4ee3\u901f\u5ea6<\/h2>\n

    \u661f\u5b87\u667a\u7b97\u5728GPU\u670d\u52a1\u5668\u79df\u7528<\/a>\u4e4b\u5916\uff0c\u628a\u201cAI \u5e94\u7528\u201d\u505a\u5230\u4e00\u952e\u5373\u73a9\uff1a
    \n– \u5185\u7f6e 1200+ \u516c\u5171\u6570\u636e\u96c6\u3001ImageNet\u3001Common Crawl\u3001\u4e2d\u6587\u533b\u7597 CMeKG \u76f4\u63a5\u6302\u8f7d\uff0c\u7701\u53bb 3\uff5e5 \u5929\u4e0b\u8f7d\u3002
    \n– \u6a21\u578b\u4ed3\u5e93\u540c\u6b65 Hugging Face \u70ed\u95e8\u6743\u91cd\uff0c\u652f\u6301\u65ad\u70b9\u7eed\u4f20\u3001\u8de8\u5b9e\u4f8b\u5171\u4eab\u3002
    \n– \u5feb\u7167\u529f\u80fd 30 \u79d2\u4fdd\u5b58\u73af\u5883\uff0cA\/B \u5b9e\u9a8c\u968f\u65f6\u56de\u6eda\uff0c\u5bf9\u6bd4\u81ea\u5efa NFS \u65b9\u6848\u6548\u7387\u63d0\u5347 4 \u500d\u3002 <\/p>\n

    \u67d0\u81ea\u52a8\u9a7e\u9a76\u5ba2\u6237\u628a 200 \u4e07\u5e27\u6570\u636e\u642c\u5230\u661f\u5b87\u667a\u7b97\u540e\uff0c\u6a21\u578b\u8fed\u4ee3\u5468\u671f\u4ece 2 \u5468\u7f29\u77ed\u5230 3 \u5929\uff0cCTO \u7684\u8bc4\u4ef7\u53ea\u6709\u4e00\u53e5\uff1a\u201c\u7701\u4e0d\u7701\u94b1 CFO \u5173\u5fc3\uff0c\u5feb\u4e0d\u5feb\u6211\u5173\u5fc3\uff0c\u73b0\u5728\u4e24\u4e2a\u90fd\u6ee1\u8db3\u4e86\u3002\u201d<\/p>\n

    05 \u73b0\u91d1\u6d41\u5b89\u5168\u57ab\uff0c\u4ece\u4f53\u9a8c\u5238\u5f00\u59cb<\/h2>\n

    \u65b0\u7528\u6237\u6ce8\u518c\u5373\u53ef\u9886\u53d6 10 \u5143\u4f53\u9a8c\u91d1<\/strong>\uff0c\u65e0\u9700\u5145\u503c\u5c31\u80fd\u8dd1 2 \u5c0f\u65f6 8 \u5361 A100\uff1b
    \n\u5982\u679c\u60f3\u505a\u538b\u6d4b\uff0c\u518d\u9886 500 \u5143 GPU\u4e91\u4e3b\u673a\u4f53\u9a8c\u5238<\/strong>\uff0c\u76f8\u5f53\u4e8e 8 \u5361 A100 \u514d\u8d39\u8dd1 24 \u5c0f\u65f6\u3002
    \n\u73b0\u5728\u767b\u5f55    \u661f\u5b87\u667a\u7b97\u5b98\u7f51<\/a>\uff0c30 \u79d2\u5f00\u901a\uff0c\u8d26\u5355\u6309\u79d2\u8ba1\u8d39\uff0c\u968f\u65f6\u63d0\u73b0\u3002 <\/p>\n

    \n

    \u628a 120 \u4e07\u7559\u5728\u8d26\u4e0a\uff0c\u8ba9 8 \u5361 A100 \u8dd1\u5728\u4e91\u7aef\u2014\u2014
    \n\u7701\u4e0b\u7684 82 \u4e07\uff0c\u53ef\u4ee5\u7ed9\u56e2\u961f\u52a0\u4e09\u540d\u7b97\u6cd5\u5de5\u7a0b\u5e08\uff0c\u4e5f\u53ef\u4ee5\u8ba9\u4e0b\u4e00\u6b21\u878d\u8d44\u4f30\u503c\u518d\u7ffb\u4e00\u500d\u3002
    \n\u9009\u62e9\u6743\uff0c\u5728\u4f60\u3002<\/p>\n<\/blockquote>\n","protected":false},"excerpt":{"rendered":"

    \u81ea\u8d2d 8 \u5361 A100 \u82b1 120 \u4e07\uff1f\u4e00\u5f20\u6210\u672c\u5bf9\u6bd4\u8868\u770b\u61c2\u201c…<\/p>\n","protected":false},"author":2,"featured_media":3166,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-3167","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-zixun"],"views":179,"_links":{"self":[{"href":"https:\/\/www.starverse-ai.com\/guide\/wp-json\/wp\/v2\/posts\/3167","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.starverse-ai.com\/guide\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.starverse-ai.com\/guide\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.starverse-ai.com\/guide\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.starverse-ai.com\/guide\/wp-json\/wp\/v2\/comments?post=3167"}],"version-history":[{"count":0,"href":"https:\/\/www.starverse-ai.com\/guide\/wp-json\/wp\/v2\/posts\/3167\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.starverse-ai.com\/guide\/wp-json\/wp\/v2\/media\/3166"}],"wp:attachment":[{"href":"https:\/\/www.starverse-ai.com\/guide\/wp-json\/wp\/v2\/media?parent=3167"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.starverse-ai.com\/guide\/wp-json\/wp\/v2\/categories?post=3167"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.starverse-ai.com\/guide\/wp-json\/wp\/v2\/tags?post=3167"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}