人工神经网络：用于人工智能的复杂网络

CarloVittorio Cannistraci Center for Complex Network Intelligence (CCNI)Tsinghua Laboratory of Brain and Intelligence 2024 Network science forsparse neuromorphic learningbrain-inspired efficient AI Master student in BioengineeringNatural and Artificial Intelligence Systems Complex Network Intelligence: Network Science for AI MorphologySparsity FullyConnected >100times more expensive than Brain < 20 Watts Complex Network Intelligence: Network Science for AI Next generation AI (ANN) Brain Connectivity Create sparsemorphological BeyondFullyConnected MorphologySparsity ANN models <20Watts <20Watts Crisis:I was a Master student in 2002 Artificial Neural Network (ANN) Brain Connectivity Crisis:Why is brain connectivitydynamicallysparse? Crisis:I was a Master student in2002 Artificial Neural Network (ANN) Brain Connectivity Crisis:Why is brain connectivitydynamicallysparse? 1. What is the computational advantage ofdynamicconnectivity sparsity in brain biology? Crisis:I was a Master student in2002 Artificial Neural Network (ANN) Brain Connectivity Crisis:Why is brain connectivitydynamicallysparse? 1. What is the computational advantage ofdynamicconnectivity sparsity in brain biology? 2. How to make profit of brain-inspireddynamicconnectivity sparsity in ANN? Crisis:I was a Master student in2002 Artificial Neural Network (ANN) Brain Connectivity Crisis:Why is brain connectivitydynamicallysparse (topology)? Crisis:I was a Master student in 2002 Brain Morphology Artificial Neural Network (ANN) Crisis:Why is brain connectivitydynamicallysparse (topology)?Crisis:What is the contribution ofmorphology? Crisis:I was a Master student in2002 Brain cell coupling Artificial Neural Network (ANN) SparseArtificial Neural Network (SANN) Artificial Neural Network (ANN) SparselyConnected FullyConnected Could a sparse Networkperforms better than a fullyconnected one? SparselyConnected FullyConnected I submitted my master thesis proposal in computer science Crisis:I was a Master student in 2002 Artificial Neural Network (ANN) Brain Connectivity Crisis:Why is brain connectivitydynamicallysparse (topology)? Crisis:I was a Master student in2002 Artificial Neural Network (ANN) Brain Connectivity Crisis:Why is brain connectivitydynamicallysparse (topology)?X My thesis proposal was rejected by the professors atComputer Science! Albert-LászlóBarabási Barabási, Albert-László;Albert,Réka"Emergence of scaling in random networks"Science.286(5439):509–512(October1999) Crisis:I was a Master student in 2002 Artificial Neural Network (ANN) Brain Connectivity Crisis:Why is brain connectivitydynamicallysparse (topology)? PhD: Study Network Science and Network Biology! My master student‘Obsession’!(2002) Heis best known for his theory of Hebbianlearning,whichheintroducedinhisclassic1949workTheOrganizationofBehavior.Hehasbeendescribedasthefatherofneuropsychologyandneuralnetworks. “neurons that fire together wire together” DonaldOldingHebb(July22,1904–August20,1985)psychologist My master student‘Obsession’!(2002) Heis best known for his theory of Hebbianlearning,whichheintroducedinhisclassic1949workTheOrganizationofBehavior.Hehasbeendescribedasthefatherofneuropsychologyandneuralnetworks. “neurons that fire together wire together” DonaldOldingHebb(July 22, 1904–August 20, 1985)psychologist My master student‘Obsession’!(2002) Heis best known for his theory of Hebbianlearning,whichheintroducedinhisclassic1949workTheOrganizationofBehavior.Hehasbeendescribedasthefatherofneuropsychologyandneuralnetworks. “neurons that fire together wire together” DonaldOldingHebb(July 22, 1904–August 20, 1985)psychologist My master student‘Obsession’!(2002) Heis best known for his theory of Hebbianlearning,whichheintroducedinhisclassic1949workTheOrganizationofBehavior.Hehasbeendescribedasthefatherofneuropsychologyandneuralnetworks. “neurons that fire together wire together” DonaldOldingHebb(July22,1904–August20,1985)psychologist My master student‘Obsession’!(2002) Heis best known for his theory of Hebbianlearning,whichheintroducedinhisclassic1949workTheOrganizationofBehavior.Hehasbeendescribedasthefatherofneuropsychologyandneuralnetworks. “neurons that fire together wire together” DonaldOldingHebb(July22,1904–August20,1985)psychologist Complex network intelligence Connectivity→Function Hownetworkconnectivityinfluencefunctionincomplexsystems,inparticularlearningandintelligence.Butalsothereverse. How to model growth oflink connectivity in complex networks? Local Community Paradigm (LCP) Local Community Paradigm (LCP) Network Shape Automata 𝐶𝐻3𝐿2(𝑢,𝑣)=σ𝑧∈𝑙2(𝑢,𝑣)11+𝑑𝑒𝑧 CH3 solely based on the minimization ofeLCL Network Automata •CH1and CH2: minimizationof theeLCLandmaximization of theiLCL.•CH3solely based on theminimization ofeLCL. […] thebest performingliterature method,Cannistraci ResourceAllocation(CRA), out of 23 different methods tested. AlessandroMuscoloni AFM