人工智能数据中心：扩大规模与拓展规模-AFL Hyperscale

gÌ|‰ oçþýuV÷Îóïþý~ýuooßßóÍkkÜk]öâoÿx2šÏûûs¿Ì^Ó]ÜÚÿk]âoöcÿÛÿ_…ík]ös¿ý÷ÿWîþý~ý|þ[õ1kWWÿx¿ýÍRÜ]g÷wýý{ý÷ÿ—‰Ì^ƒöÕö__ýý2 è^Îërÿ 02 01 þý~ýN~nûÏ þý~ýë2017~ïgöÛ ·ßþý~ýÿAIÿ1~nÿMLÿÜßïŠkßÿLLMsÿöy÷ëÿ2o‚ëÛÎÿoëÿÿWîkß1¯ÿÜëv2 ã݉öAIÝ{ùÿÏÛÛÿgöTransformerkßöûó2o‚ߏÎwöÍköAIkßÜÞ«ÿýÛöÓ]ÿ2 03 04 þý~ý|þößo kþý~ýÿx¿ýÍk ã«óïAIuooßkuÿsìkÍkÜk]g2 Îë[ÿ_âo1¯wkWÜ]Íâoö[õ2ýuÎëڟþÜYß÷wÿÿ2 05 þý~ýöogÿ ã«õuÿÿÏÛVÿkß1™÷ßOö\oÜk]V__ÿÿ2o‚ß«»ÎuooßÞÔÿDCIÿûoÿÝûßçåþÞÿö—n2 _…ÿ o·¿ÿ âo_…ÿÿ{Þ¿wÔßÿAFLÿ þo·ÿýÿÚÿâoþÿÿAFL r_þý~ýÿûó~ϟÓ]ÿwÍkܟþûNsîoý2Ûþû[ýâoóONÿboßßâo_ÍkܟþN×ßÎßo2ßoNnßñöâoeÏ2 þo·ÿýÿÚÿâoþÿÿAFL þý~ýÿAIÿ1~nÿMLÿÜßïŠkßÿLLMsÿûÏ þý~ýÿAIÿog³ßíg̚~—‰þ~ýöÿóö~vïþÿÏÛÿvëëwïŠ1ÏÉ÷1ï÷Ï{1ïŠÿÛ1nÜÿ˜ëóÿ2 ~nÿMLÿ¯ÿÿýïëíoO~óßûþ{ó{ö×~þöÝÞ2ýþnÿDLÿoå—þ~œö~n2ýþn}ù~þýÿþÿANNÿöÿýÿßßÿý[n¶ÿ]vŸuzïÿ~ýÏ{]guoÖoösÿ2ßïŠkßÿLLMÿo_ý]vïŠöýþnkß2 DLÿýÿï]vÿ_wS}Oõ[sÿöu_Wïo2ÏÛÿLLMsÿïrœûçëvó{öþïŠÝÞÿÏÛÿGPT-4ÿÿ~^_ÿïþßÜy{÷ßßßý_2 ÿoëÿÿkß1¯ÿÜëv ~nÏ{í_Óý_ßÌ×~ëv1Zû»Ÿó~]óþ~ýökß2¯ÿ¶ÿíÛ×_™Ûuo~_WÝÞïßóggý2ëv¶ÿÿ¯ÿ}ökßV÷õuoÿÞ}_W^ök_Ï{ÿ~ëúr»ŸÝÞ2o‚óßÎûkß1¯ÿÜëvöÿxvë2 kß ~nÿMLÿöïÛOÿNnkßïèÎNþ«¯ÿïÏ{k_ܜoõ1oÉuooNõsÿöÿý2ÏÛÿkß}”ÿýWîœoy|1Ï{þßïÛyo}wÌ~óßÚþngWöu[Wó_ž2 ïOkßïèíkßßÿ{ÎëößökßÿÿӗON‚ÿo˜~<ë2017~ïgöþý~ýÛ=ÿÿ ÷wnkß ÷wnkßÎÿÏ{×ö{Ïon2ÏÛÿNn÷wnkßÿïyoWþ\ûíþè{öþßÿÏÉNÏ{ûïûí2 ß÷wnkß å÷wnkßoo»uooû~–Ïök_vVþ2âoWîÚÿ^þuoùVþÿÜßOuo]ggÿûWuoïßóöomöV÷ÿ2 Wnkß WnkߚÏNÿÛöÞúgn44ߙ«»~_óvé2ßkß~oÜ~þ{žßßrÞ}2 ÿ¯ ¯ÿ¶ÿ}_kßßÌ×~öœo2o¶ÿWî‰nkßZûœoO_ÿ^kßö·ÎNnœÛöuoÖ2Ÿ^ßÌÓuuÿoûÎg_Wï2 ¯ÿkßíÛ[n¶ÿÿ uowÖ {þþs…ÿÛ~ný{^ÜuoùÿÿßûwÖÜuvNkßgþþöþsöß^[WöuoÖ2 uoœ]v uoœ]víÛûuoßÌovÜïcÿïÿ~¯ÿZ×_2ßÿýWîÏ{uoõŸÜ{Uy|ÿûþÛßßÌ_NWïóÚnm÷ÿïÛ^uoV~¯ÿÖÿ}ίÿkßÿܞËÖÿ}ÎÏkßgýÿ2 kߙë kߙëWî[nƒßö}2ÏÛÿß1oìuoÖÿý’\ÿþ2[nkßOõßÌïïoßÿï~ûÏÜ~Ûg{Ýkßï¿rggý2 _W ŸYÿ~ný{^ÜuoùÿßûÛONnyýu44Nnéߜo×~gögýgo2çOgÿÿý_ß]uÜöõkßöÓuïßów44sÿÏ[kÓuuÿyýu_OÝ~×}Õ2 Ï gþ¶ÿÿýWî[n¶ÿ2ÏÛÿý{^ÿï}žËuog·×å_ögýÏ2ßoww‰èçÏþÿ\ÿ¯ÿuoèóï}ÿžËuoèóOÿÜkÿ\ÿu_èóOÿ2~ÉöëóýhWîk[WÿsÿûÏþÝ߯ÿuoÿòéÿ1dropoutÿsÿŸûöuo[Öï¶kÏþßßÿÜî۞ËÿsÿVr~îÛ_}¯ÿܞËuoÖÿÝkï¶kÏþßßÿ2 ëí ëí¶ÿ—‰¯ÿ}ökßÿÎõö1oÉÏöuoß̜o2ßokßÿïëïwÞ}Îóß^}O_ÿ¯ÿܞËög^¶ÿ2 ëvÏ{Wîÿ Ÿu]v ßNo¾öþöošÏUkßoŸuN¯ÿuo×_¶ÿb}öýýþ{Ýöuoÿïóڜo×~þ2ÏÛÿ×}þ\öýý]vy|ÿÏÛÿ}_uvoOu{Uy|ÿÿï~ßomökߟu]vÿΌóÚNõg2 œo o¶ÿÿïkßßû]võö1oÉÏöuoÿå»oWnuoùßouo{kÿ~ß÷ÕZûœovóßoÿ|öÉë2 ^]v ^]v¶ÿWîñnO\ö¶ÿÿ}ÎþüŸû2ÏÛÿÿ\[nœoï[þNnÏîö1ö×~ögþœo2 sÎþý~ý܍ÍkuooߘößNo—ûÿÿӗsîgõöu[nÿ Íkÿþý~ý} kïOÿu[nÿ þý~ýë2017~ïgöÛ 2017~oßwýþnÿDLÿžß[n݉Ý{ùößó44{{oï÷Ï{ÜþßÏ{ý÷2ÍkoìuoÖöåþÿ}gNÌ^~nÿMLÿ¯ÿâoý÷ößoþÿ\ÿßkßnm÷ßrÎóW2 ÏÛÿwÿÿþÿCNNs 3 _ìÎþßÏ{öþhèoÜVö{ëýþnÿýÿÜÿÿÿþÿRNNs 3 {}Y_Ÿuö»ßg~úßuoÿÛëwïŠÿóß__œoöýþnkßÿö}ßÿßÎ2012~ö15.3%öï÷obßO21 2017~Ï2.3%2- öOöï÷ïW~ö]öœoïÿΌoþÎÿÿ2 \ÿýþnkßï÷Ï{žßögýßróWÿÿï|~þ\2017~ßóÎ5.1%öûßï÷Ý{ù23þ parity ϝï÷2ßß_booöõ|Îþý~ýTnÞ}oöÛÿgÜßoÛ2 _Šÿ¿oTransformerkßûÏ 2017~ûzÿ<ìoÛsb—=4(Vaswani et al) ÏÿÎTransformerkßÿßÿýo_÷õuþý~ýâožßöûûû|gß]2u¿oö{Oùÿ\óößÿ»çëÿÎNýõöýþn÷çýý44ÿÎ2014~öìoÛvÿBahdanau et alÿ2ëγ÷ÿÿTransformerkßÿÿr~LLM÷ç¿«öÿ÷ÿ~óïþý~ýÞ}Û¿oöBard44Î2024~2o8åö]~Gemini44öÓ]þÎÓï2 ÛÛ~kßÿ}gÓ]^^wùßyïûrìoÛvNÿíöÎÌ^ûÿÿÿþÿRNNsÿÜwÿÿþÿCNNsÿößß2ws÷ÝWîëwïŠ]vÿNLPÿý÷öÝßo2 ÛÛ~÷ç wŒÿNRNNsÜLSTMskúß]vuomO\ÿTransformers\÷]voßo»ÿs\÷ûvŸuuoöboøVÿŒOoNnçNnÿÿΌóÚÎ~ÌWÜm÷ÿïòŸ¯ÿÜëvÏ{oö_Ó|2 Transformerkß×}ëìoÛvÿßWo»þûÎoßÌV÷ÿΌóÚ¯ÿŸþÿoýýßkßý_wkuooöÿÝûßßsÿÿ2 ë2017~ïgÿTransformer÷çÿr~ocëwïŠ{ÿNLPÿžßóïgYßß]ö‰1ÿxkßß44ÏÛBERTÜGPT2ßNAIžßös¿÷{~AIâoöÿÿŸ×}ÛwŸ^öÍk÷ÍyÛÎÿx2 1. PyTorch2. Statista3. Microsoft4. arXiv ÿÿïUööAIkß Ÿw÷õöëûÿkßÓuußö~×ÞòÿÎíçou~OÓuökßïÛ~óïçouSÿóuOÿÓuökßÿoßwUöÍkAIkßöÿ2ÏÛÿ2019~Ó_öOpenAIöGPT-2ço15ÿÓu25Óu2wŒÿN~^ÿ2020~öGPT-3kßßߍÏÎßnu_ÿ¿rÎ1750ÿÓu2r2023~ÿGPT-4öÓ_oßwkßÓuöÛNkÝ{ù_Þÿÿ«o1800ÿÓu2 åþÞÿö¯ÿuoßÜ]gþý~ýÏ{b—ö«ÿýÛNþý~ýkßÍköÌ^ÞÿþÌ44OpenAIç^ùÿë2012~ïgÿûvþý~ýkßb—ö«ÿýÛï3.4noÿN6\ÿgßywuoßöïÞÏßuoÖ}ίÿßrÿÞ}2 2010~ó2011~õÿywÞÔN[þö{õuoÎ2ý_‚Þÿr5ý_‚27 2019~ó2020~õÿõÞuoö{ßÎ41ý_‚Þÿó64ý_‚27œo~{ÿ2024~ó2028~õÿïu_^Î149ý_‚Þÿr394ý_‚27. ßßuoûûÎþý~ýÓ]_oo[öýÛÜ~×ösz44ÏÛ[øÜÿk]þëóýh{ý÷44ö_o2 ^ÍkN÷Í 2023~ÿywþý~ý^ÿ|¿rþ1966.3ÿÿS28ÿœ«2024~ó2030~õö]\~Þÿ÷ÿCAGRÿ~36.6%2ëúßNÞÿöö}Wîcÿö|~Ü[õÿ|woýþnÿDLÿ1ëwïŠ]vÿNLPÿÜr_þý~ýÿgenerative AIÿžßÿbŸö<ùâ}û=Wîÿï1MetaÜÞþšœ«^÷Í1OÿÿS29ogñ~Õÿþý~ýžß2 oNï^ûÿ o}Üþý~ýï^ûAIkß_ÓýZûÎ~×ÿïnžßýÓgwþ{1þûŒÛþÞíUö_}2 ×óNÿuo}ûúöAIÿx|~_ìÎv»ßoÜÿ[õ2wŒÿûAIâoö—nýÿÿõï^Œßo}ZûÎÞÞÿkßÍkkÎ29]210þÎo}ökßuß22023~ÿÌ^ïökßuß¿rÎ5111 No}ocökßußþÿÿ^…¿rÎ15ÿo}Ný^}ö\__ÿõÎ21nkßöûóÿ211~×ökß2ßöяÍþÜ«ÿ|þöÿ}gowwù¥}ûÿïòŸþý~ýößo2 yw|\5. OpenAI 6. MIT TechnologyReview 7. Statista 8. Grand View Research 9. Investopedia 10. MIT Sloan 11. þý~ýg ]us¿ÿÿþý~ý|~Ü_Ӟß]Î^}žYwO2ÿÿO]_Wÿço2490ÿÿSö÷Í212ùþÍý÷ÿ~^ñN60%212ÿÿþ^þý~ý|~þ\Ü}ûý_2uç^2024ÿïwÿ 12. Techopedia 13. ÿ×½wûv\ oÿŸw^ÿ{ÖÎ950ÿÿS212ùþ÷Ío~Î11%12~þÿþý~ý|~þ\2 óÿó]Oÿs^ÿ210ÿÿS13þý~ý^|œ«r2035~^¿r1OÿÿS2wÞ~×…WîïòW1òÿÜýÿÿïnÿÿýÿ{wUïÛö_[O^aÿÿ2ßßßoOÏòŸÎþý~ýâoöÓ]ÿŒ^Y°Îywþý~ýÜovo×2 þý~ýöÿŸÓ]«Nncÿöÿbo»ÿkßÍkÜ]gþöguÿÞÿ2óïþý~ýkßÿÛßïŠkßÿLLMsÿÜëÓÿÿÿóWu~ÿruOÿöÓu2ßýÞÿû¯ÿÜøßßkßb—ö«ÿÿx¿ýïÎýßöÝ2ÏûS~oÿ¯ÿ_ÿkßb—ö«ÿïOrßno}_ÿN2 14. ÷ ï AI «ÿßkßö«ÿ—