2023中国人工智能系列白皮书--深度学习

!"#$%&'()*+ ——,-./ !"#$%&'( )○)*+,- !"#$%&'()*+,-./0 12234567 89134:#; < 1 34=2>2?2@ ABC2A2D2EFG2:HI 22222:JK2LGM2NOP /22Q4RST2U2V2=2W2=XY2Z[J2\]M2 22222^_`2abc2def2ghP2?2i2j#`2 22222klm2nop2qrs2tuB2u2v2A2s2 22222Awx2Ayz2{P|2}PI2~Ä2Å2Ç2 22222ÉXÑ2Ö2Ü2áàâ2Eäã2EåX2çéP2 22222:hè2:êë2:2í2:ìî2ïñó·òôö2 22222õSú2ùûG2ü2†2°2I2¢£§2¢•%2 22222¢2¶2ß2¶2N#®2N©™2Né ́2N2>2 22222 ̈≠Æ2Ø∞±2 !"#$%&'()*+,----≤≥•¥-.μ∂ nop2 ∑f2 =>2 ∏[2 :π2 =£f2 ¢c2 L∫X22=ªº 2EJΩ2 L®2 æø¿ ! " !1" #$%&'()*+ .................................................................. 1 1.1 $%&'¡¬√ƒ≈∆ ............................................................. 1 1.1.1 $%&'¡¬√ .................................................................. 1 1.1.2 $%&'¡≈∆ ................................................................ 2 1.2 $%&'¡k«»... ................................................................. 3 1.2.1 Àà ................................................................................ 4 1.2.2 ÕŒòœ– ........................................................................ 4 1.2.3 —“”‘ ............................................................................ 6 1.2.4 $Ã’÷ ............................................................................ 7 1.2.5 À”◊ÿ ............................................................................ 8 1.2.6 Ÿ⁄ä‹ ........................................................................ 8 1.3 $%&'¡›e ......................................................................... 9 1.4 $%&'¡fifl‡ ................................................................... 12 1.4.1 ÷•¥ .......................................................................... 12 1.4.2 ‚„‰ÂÊÁ .................................................................. 14 1.4.3 ËÈœ– .......................................................................... 15 1.4.4 ÍÎ⁄Ï .......................................................................... 15 1.4.5 ≤ÌÓÔŸ⁄à .............................................................. 16 1.5 $%&'¡Ò‡ ................................................................... 17 1.5.1 ÚÛËÈœ– .................................................................. 17 1.5.2 ÙB’ıœ– .................................................................. 18 1.5.3 ˆ ̃‚ ̄. ̆· .............................................................. 19 1.5.4 ̇ ̊•¥ .......................................................................... 19 1.5.5 À” ̧ ̋ .......................................................................... 20 1.5.6 ‚ ̄ ̨ˇ .......................................................................... 21 1.5.7 AlphaGO .......................................................................... 22 1.5.8 AlphaFold ......................................................................... 23 1.5.9 ChatGPT ........................................................................... 23 1.6 $%&'¡!" ....................................................................... 25 1.6.1 #$$%&' .................................................................. 25 1.6.2 %—&'()—* .......................................................... 25 1.6.3 %3+—* ...................................................................... 26 1.6.4 ,ü$%&'¡œ–-. .............................................. 26 1.6.5 /0Ÿ⁄ƒ12•¥ ...................................................... 26 1.6.6 $Ã34567 .............................................................. 27 1.6.7 89:;<o%=>£:; .......................................... 27 1.6.8 $%&'?Á .................................................................. 28 1.6.9 $%&'`@¡A4> .................................................. 28 !2" ,-./01 .......................................................................... 29 2.1 ÚÛËÈœ– ........................................................................... 29 2.1.1ÚÛB ................................................................................. 30 2.1.2 CDE: ............................................................................ 32 2.1.3 F>B ................................................................................ 33 2.1.4 .GHB ............................................................................ 33 2.2 ÈI¡œ–—* ....................................................................... 33 2.2.1 LeNetœ–—* .................................................................. 33 2.2.2 AlexNetœ–—* ............................................................... 34 2.2.3 VGGœ–—* ................................................................... 36 2.2.4 GoogLeNetœ–—* ......................................................... 37 2.2.5 ResNetœ–—* ................................................................ 39 2.2.6 ShuffleNetœ–—* .......................................................... 40 2.2.7 Vision Transformer —* .................................................... 41 2.2.8 JKËÈœ– ......................................