{"id":6402,"date":"2026-05-19T09:37:25","date_gmt":"2026-05-19T01:37:25","guid":{"rendered":"https:\/\/www.starverse-ai.com\/guide\/?p=6402"},"modified":"2026-05-19T09:37:26","modified_gmt":"2026-05-19T01:37:26","slug":"%e4%bb%8eflops%e5%88%b0%e5%ae%9e%e9%99%85%e5%90%9e%e5%90%90%e9%87%8f%ef%bc%8c%e5%a6%82%e4%bd%95%e7%a7%91%e5%ad%a6%e8%a1%a1%e9%87%8fgpu%e6%9c%8d%e5%8a%a1%e5%99%a8%e7%9a%84%e7%9c%9f%e5%ae%9e%e7%ae%97","status":"publish","type":"post","link":"https:\/\/www.starverse-ai.com\/guide\/archives\/6402","title":{"rendered":"\u4eceFLOPs\u5230\u5b9e\u9645\u541e\u5410\u91cf\uff0c\u5982\u4f55\u79d1\u5b66\u8861\u91cfGPU\u670d\u52a1\u5668\u7684\u771f\u5b9e\u7b97\u529b\uff1f"},"content":{"rendered":"\n

\u5f15\u8a00\uff1aFLOPs\u2260\u771f\u5b9e\u7b97\u529b\uff0c\u884c\u4e1a\u4e9f\u9700\u79d1\u5b66\u8861\u91cf\u4f53\u7cfb<\/h3>\n\n\n\n

\u5f53\u524dAI\u5927\u6a21\u578b\u3001\u79d1\u7814\u4eff\u771f\u3001\u91d1\u878d\u91cf\u5316\u7b49\u573a\u666f\u7b97\u529b\u9700\u6c42\u7206\u53d1\uff0cGPU\u670d\u52a1\u5668\u6210\u4e3a\u6838\u5fc3\u7b97\u529b\u8f7d\u4f53\uff0c\u4f46\u5e02\u573a\u666e\u904d\u5b58\u5728\u201c\u552fFLOPs\u8bba\u201d\u7684\u8ba4\u77e5\u8bef\u533a\u3002FLOPs\uff08\u6bcf\u79d2\u6d6e\u70b9\u8fd0\u7b97\u6b21\u6570\uff09\u4f5c\u4e3aGPU\u6838\u5fc3\u53c2\u6570\uff0c\u4ec5\u4ee3\u8868\u7406\u8bba\u5cf0\u503c\u7b97\u529b\uff0c\u5b9e\u9645\u5e94\u7528\u4e2d\u53d7\u591a\u56e0\u7d20\u5f71\u54cd\uff0c\u5176\u6570\u503c\u4e0e\u771f\u5b9e\u541e\u5410\u91cf\u5dee\u8ddd\u53ef\u8fbe30%-50%\u3002\u636e\u884c\u4e1a\u6d4b\u7b97\uff0c2026\u5e74\u56fd\u5185GPU\u7b97\u529b\u79df\u7528\u5e02\u573a\u4e2d\uff0c28%\u7684\u79df\u7528\u7ea0\u7eb7\u6e90\u4e8e\u53c2\u6570\u8ba4\u77e5\u504f\u5dee\uff0c45%\u7684\u5c0f\u578b\u5e73\u53f0\u5b58\u5728\u7b97\u529b\u865a\u6807\u95ee\u9898\u3002<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

\u6838\u5fc3\u8ba4\u77e5\uff1aFLOPs\u7684\u5c40\u9650\u6027\uff0c\u4e3a\u4f55\u4e0d\u80fd\u4ee3\u8868\u771f\u5b9e\u7b97\u529b\uff1f<\/h3>\n\n\n\n

FLOPs\u662fGPU\u82af\u7247\u7684\u7406\u8bba\u8fd0\u7b97\u6781\u9650\uff0c\u5355\u4f4d\u4ee5TFLOPS\uff08\u6bcf\u79d2\u4e07\u4ebf\u6b21\u6d6e\u70b9\u8fd0\u7b97\uff09\u3001PFLOPS\uff08\u6bcf\u79d2\u5343\u4e07\u4ebf\u6b21\u6d6e\u70b9\u8fd0\u7b97\uff09\u8ba1\u91cf\u3002\u4f8b\u5982\uff0cNVIDIA A100\uff0880GB\uff09\u7684FP16\u7b97\u529b\u4e3a312 TFLOPS\uff0cNVIDIA H100\u7684FP8\u7b97\u529b\u53ef\u8fbe1.97 PFLOPS\uff0c\u4f46\u8fd9\u4e00\u6570\u503c\u662f\u7406\u60f3\u73af\u5883\u4e0b\u7684\u6d4b\u8bd5\u7ed3\u679c\uff0c\u672a\u8003\u8651\u5b9e\u9645\u5e94\u7528\u4e2d\u7684\u591a\u91cd\u635f\u8017\u3002<\/p>\n\n\n\n

\u5176\u6838\u5fc3\u5c40\u9650\u6027\u4f53\u73b0\u5728\u4e09\u70b9\uff1a\u4e00\u662f\u7cbe\u5ea6\u5f71\u54cd\uff0cFP32\u3001FP16\u3001FP8\u7b49\u4e0d\u540c\u7cbe\u5ea6\u4e0b\uff0cFLOPs\u6570\u503c\u5dee\u5f02\u663e\u8457\uff0cH100\u7684FP8\u7b97\u529b\u662fFP16\u76846\u500d\uff0c\u800c\u5b9e\u9645\u573a\u666f\u4e2d\u7cbe\u5ea6\u9009\u62e9\u9700\u9002\u914d\u4efb\u52a1\u9700\u6c42\uff0c\u65e0\u6cd5\u59cb\u7ec8\u4ee5\u6700\u9ad8\u7cbe\u5ea6\u8fd0\u884c\uff1b\u4e8c\u662f\u786c\u4ef6\u635f\u8017\uff0cGPU\u663e\u5b58\u5e26\u5bbd\u3001\u6563\u70ed\u6548\u7387\u3001\u4f9b\u7535\u7a33\u5b9a\u6027\u4f1a\u76f4\u63a5\u62c9\u4f4e\u5b9e\u9645\u7b97\u529b\uff0cRTX4090\u5b9e\u6d4b\u7b97\u529b\u8f83\u6807\u79f0\u503c\u53ef\u4f4e15%-20%\uff1b\u4e09\u662f\u8f6f\u4ef6\u4e0e\u573a\u666f\u635f\u8017\uff0c\u6a21\u578b\u67b6\u6784\u3001\u5e76\u884c\u7b56\u7565\u3001\u6570\u636e\u4f20\u8f93\u5ef6\u8fdf\u7b49\uff0c\u4f1a\u8fdb\u4e00\u6b65\u964d\u4f4e\u7b97\u529b\u5229\u7528\u7387\uff0c\u5355GPU\u8bad\u7ec3\u65f6FLOPs\u5229\u7528\u7387\u4ec560%-80%\u3002<\/p>\n\n\n\n

\u5173\u952e\u7a81\u7834\uff1a\u5b9e\u9645\u541e\u5410\u91cf\uff0c\u771f\u5b9e\u7b97\u529b\u7684\u6838\u5fc3\u8861\u91cf\u6307\u6807<\/h3>\n\n\n\n

\u5b9e\u9645\u541e\u5410\u91cf\u662f\u6307GPU\u670d\u52a1\u5668\u5728\u7279\u5b9a\u573a\u666f\u4e0b\uff0c\u5355\u4f4d\u65f6\u95f4\u5185\u53ef\u5904\u7406\u7684\u4efb\u52a1\u91cf\uff08\u5982\u6837\u672c\u6570\/\u79d2\u3001tokens\/\u79d2\uff09\uff0c\u662f\u8d34\u5408\u5b9e\u9645\u5e94\u7528\u7684\u6838\u5fc3\u7b97\u529b\u6307\u6807\uff0c\u5176\u8ba1\u7b97\u9700\u7ed3\u5408\u4efb\u52a1\u7c7b\u578b\u3001\u786c\u4ef6\u914d\u7f6e\u3001\u8f6f\u4ef6\u4f18\u5316\u7efc\u5408\u6d4b\u7b97\u3002<\/p>\n\n\n\n

\u4ee5AI\u8bad\u7ec3\u573a\u666f\u4e3a\u4f8b\uff0c\u541e\u5410\u91cf\u8ba1\u7b97\u516c\u5f0f\u4e3a\uff1a\u541e\u5410\u91cf=\uff08\u6279\u6b21\u5927\u5c0f\u00d7GPU\u6570\u91cf\uff09\u00f7\u6bcf\u6279\u8bad\u7ec3\u65f6\u95f4\uff0c\u5176\u4e2d\u6bcf\u6279\u8bad\u7ec3\u65f6\u95f4\u5305\u542b\u8ba1\u7b97\u65f6\u95f4\u4e0e\u901a\u4fe1\u65f6\u95f4\u3002MLPerf\u5b9e\u6d4b\u6570\u636e\u663e\u793a\uff0c8\u5757GPU\u8bad\u7ec3BERT-large\u6a21\u578b\uff0c\u6279\u6b21\u5927\u5c0f32\uff0c\u6bcf\u6279\u8bad\u7ec3\u65f6\u95f40.5\u79d2\uff0c\u541e\u5410\u91cf\u53ef\u8fbe256\u6837\u672c\/\u79d2\uff1b16\u5757GPU\u96c6\u7fa4\u8bad\u7ec3\u65f6\uff0c\u541e\u5410\u91cf\u63d0\u5347\u81f3427\u6837\u672c\/\u79d2\uff0c\u52a0\u901f\u6bd411.11\uff0c\u6548\u738769.4%\u3002<\/p>\n\n\n\n

\u9664\u541e\u5410\u91cf\u5916\uff0c\u8861\u91cf\u771f\u5b9e\u7b97\u529b\u8fd8\u9700\u517c\u987e\u4e09\u5927\u8f85\u52a9\u6307\u6807\uff1a\u901a\u4fe1\u5e26\u5bbd\uff08InfiniBand HDR\u5e26\u5bbd200 GB\/s\uff09\u3001\u5ef6\u8fdf\uff08RDMA\u5ef6\u8fdf1-10 \u03bcs\uff09\u3001\u80fd\u6548\u6bd4\uff08H100 FP8\u80fd\u6548\u6bd460 TFLOPS\/W\uff09\uff0c\u56db\u8005\u7ed3\u5408\u624d\u80fd\u5168\u9762\u53cd\u6620GPU\u670d\u52a1\u5668\u7684\u771f\u5b9e\u7b97\u529b\u6c34\u5e73\u3002<\/p>\n\n\n\n

\u5b9e\u8df5\u843d\u5730\uff1a\u79d1\u5b66\u8861\u91cf\u6d41\u7a0b+\u661f\u5b87\u667a\u7b97\u5b9e\u6d4b\u53c2\u8003<\/h3>\n\n\n\n

\u79d1\u5b66\u8861\u91cfGPU\u670d\u52a1\u5668\u771f\u5b9e\u7b97\u529b\uff0c\u9700\u9075\u5faa\u201c\u53c2\u6570\u6838\u67e5\u2014\u573a\u666f\u5b9e\u6d4b\u2014\u7efc\u5408\u8bc4\u4f30\u201d\u4e09\u6b65\u6d41\u7a0b\uff0c\u6bcf\u4e00\u6b65\u5747\u9700\u4f9d\u6258\u5177\u4f53\u6570\u636e\u652f\u6491\uff0c\u907f\u514d\u4e3b\u89c2\u5224\u65ad\u3002<\/p>\n\n\n\n

\u7b2c\u4e00\u6b65\uff0c\u53c2\u6570\u6838\u67e5\uff0c\u660e\u786e\u786c\u4ef6\u57fa\u7840\u6307\u6807\uff0c\u91cd\u70b9\u5173\u6ce8FLOPs\u7cbe\u5ea6\u9002\u914d\u6027\u3001\u663e\u5b58\u89c4\u683c\u3001\u5e26\u5bbd\u53c2\u6570\uff0c\u6392\u9664\u865a\u6807\u9690\u60a3\u3002\u661f\u5b87\u667a\u7b97\u5b9e\u6d4b\u6570\u636e\u663e\u793a\uff0c\u5176RTX4090\u5355\u5361\u5b9e\u6d4b\u7b97\u529b\u8fbe118 TFLOPS\uff0c\u63a5\u8fd1\u6807\u79f0\u503c\uff08132 TFLOPS\uff09\uff0c\u7b97\u529b\u5229\u7528\u7387\u7a33\u5b9a\u572890%\u4ee5\u4e0a\uff0c\u4f18\u4e8e\u884c\u4e1a\u5e73\u5747\u6c34\u5e73\u3002<\/p>\n\n\n\n

\u7b2c\u4e8c\u6b65\uff0c\u573a\u666f\u5b9e\u6d4b\uff0c\u9009\u62e9\u9002\u914d\u573a\u666f\u7684\u57fa\u51c6\u6d4b\u8bd5\u5de5\u5177\uff0c\u5982AI\u8bad\u7ec3\u7528MLPerf\u3001\u901a\u4fe1\u6027\u80fd\u7528NCCL-tests\u3001\u9ad8\u6027\u80fd\u8ba1\u7b97\u7528HPL\u3002\u661f\u5b87\u667a\u7b97\u5728\u91d1\u878d\u98ce\u63a7\u573a\u666f\u5b9e\u6d4b\u4e2d\uff0c\u91c7\u7528A100 GPU\u96c6\u7fa4\uff0c\u53ef\u5c06\u98ce\u9669\u6a21\u578b\u8bad\u7ec3\u65f6\u95f4\u4eceCPU\u768472\u5c0f\u65f6\u538b\u7f29\u81f34\u5c0f\u65f6\u5185\uff0c\u541e\u5410\u91cf\u8fbe10\u4ebf\u7b14\/\u65e5\uff0c\u6b3a\u8bc8\u8bc6\u522b\u5ef6\u8fdf\u226412ms\uff0c\u7b97\u529b\u5229\u7528\u7387\u63d0\u5347\u81f390%\u4ee5\u4e0a\uff0c\u8f83\u884c\u4e1a\u5e73\u5747\u6c34\u5e73\u63d0\u534755\u4e2a\u767e\u5206\u70b9\u3002<\/p>\n\n\n\n

\u7b2c\u4e09\u6b65\uff0c\u7efc\u5408\u8bc4\u4f30\uff0c\u7ed3\u5408\u541e\u5410\u91cf\u3001\u901a\u4fe1\u5ef6\u8fdf\u3001\u80fd\u6548\u6bd4\u3001\u6269\u5c55\u6027\u56db\u5927\u6307\u6807\uff0c\u5f62\u6210\u5b8c\u6574\u7b97\u529b\u8bc4\u4f30\u62a5\u544a\u3002\u661f\u5b87\u667a\u7b97GPU\u96c6\u7fa4\u5728\u591a\u5361\u6269\u5c55\u6d4b\u8bd5\u4e2d\uff0c8\u5361\u96c6\u7fa4\u52a0\u901f\u6bd46.67\uff0c\u6548\u738783.4%\uff0c16\u5361\u96c6\u7fa4\u6548\u738769.4%\uff0c\u7b26\u5408Amdahl\u5b9a\u5f8b\u6d4b\u7b97\u6807\u51c6\uff0c\u5c55\u73b0\u51fa\u4f18\u5f02\u7684\u6269\u5c55\u6027\u3002<\/p>\n\n\n\n

\u7ed3\u8bed\uff1a\u5efa\u7acb\u79d1\u5b66\u8861\u91cf\u4f53\u7cfb\uff0c\u91ca\u653eGPU\u7b97\u529b\u4ef7\u503c<\/h3>\n\n\n\n

\u544a\u522b\u201c\u552fFLOPs\u8bba\u201d\uff0c\u4ee5\u5b9e\u9645\u541e\u5410\u91cf\u4e3a\u6838\u5fc3\uff0c\u7ed3\u5408\u901a\u4fe1\u6027\u80fd\u3001\u80fd\u6548\u6bd4\u3001\u6269\u5c55\u6027\u7684\u7efc\u5408\u8861\u91cf\u4f53\u7cfb\uff0c\u624d\u662f\u9002\u914d\u884c\u4e1a\u9700\u6c42\u7684GPU\u670d\u52a1\u5668\u7b97\u529b\u8bc4\u4f30\u65b9\u5f0f\u3002\u661f\u5b87\u667a\u7b97\u4f9d\u62587500\u5361GPU\u96c6\u7fa4\uff0c\u901a\u8fc7\u786c\u4ef6\u4f18\u5316\u3001\u8c03\u5ea6\u7b97\u6cd5\u5347\u7ea7\uff0c\u5b9e\u73b0\u7b97\u529b\u5229\u7528\u738790%\u4ee5\u4e0a\u3001\u6ce2\u52a8\u22642%\uff0c\u540c\u65f6\u63d0\u4f9b\u573a\u666f\u5316\u5b9a\u5236\u65b9\u6848\uff0c\u9002\u914d\u4e0d\u540c\u884c\u4e1a\u7b97\u529b\u9700\u6c42\uff0c\u5176\u5408\u89c4\u8d44\u8d28\u4e0e\u5b9e\u6d4b\u8868\u73b0\uff0c\u4e3a\u884c\u4e1a\u63d0\u4f9b\u4e86\u53ef\u4fe1\u7684\u7b97\u529b\u53c2\u8003\u8303\u672c\u3002<\/p>\n\n\n\n

\u968f\u7740AI\u6280\u672f\u6301\u7eed\u8fed\u4ee3\uff0cGPU\u670d\u52a1\u5668\u771f\u5b9e\u7b97\u529b\u7684\u8861\u91cf\u6807\u51c6\u5c06\u8fdb\u4e00\u6b65\u7ec6\u5316\uff0c\u552f\u6709\u7acb\u8db3\u5b9e\u9645\u573a\u666f\u3001\u4f9d\u6258\u5b9e\u6d4b\u6570\u636e\uff0c\u624d\u80fd\u7cbe\u51c6\u5339\u914d\u7b97\u529b\u9700\u6c42\uff0c\u907f\u514d\u8d44\u6e90\u6d6a\u8d39\u4e0e\u6210\u672c\u635f\u8017\u3002<\/p>\n","protected":false},"excerpt":{"rendered":"

\u5f15\u8a00\uff1aFLOPs\u2260\u771f\u5b9e\u7b97\u529b\uff0c\u884c\u4e1a\u4e9f\u9700\u79d1\u5b66\u8861\u91cf\u4f53\u7cfb \u5f53\u524dAI\u5927…<\/p>\n","protected":false},"author":2,"featured_media":6403,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-6402","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-zixun"],"views":6,"_links":{"self":[{"href":"https:\/\/www.starverse-ai.com\/guide\/wp-json\/wp\/v2\/posts\/6402","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.starverse-ai.com\/guide\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.starverse-ai.com\/guide\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.starverse-ai.com\/guide\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.starverse-ai.com\/guide\/wp-json\/wp\/v2\/comments?post=6402"}],"version-history":[{"count":1,"href":"https:\/\/www.starverse-ai.com\/guide\/wp-json\/wp\/v2\/posts\/6402\/revisions"}],"predecessor-version":[{"id":6404,"href":"https:\/\/www.starverse-ai.com\/guide\/wp-json\/wp\/v2\/posts\/6402\/revisions\/6404"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.starverse-ai.com\/guide\/wp-json\/wp\/v2\/media\/6403"}],"wp:attachment":[{"href":"https:\/\/www.starverse-ai.com\/guide\/wp-json\/wp\/v2\/media?parent=6402"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.starverse-ai.com\/guide\/wp-json\/wp\/v2\/categories?post=6402"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.starverse-ai.com\/guide\/wp-json\/wp\/v2\/tags?post=6402"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}