"매 4 billion year 의 deep learning". 매 survival + reproduction = 매 reward. 매 evolution = 매 backpropagation. 매 modern AI 의 still 매 surpass X — 매 energy efficiency, 매 few-shot, 매 embodied. 매 inspiration 의 source.
📖 핵심
매 AI vs Biological 비교
측면
Biological
AI (current)
Energy
매 20W (brain)
매 100W-MW (LLM)
Few-shot
매 1-5 example
매 trillion token
Embodied
✓
매 robotics 시작
Continual learn
✓
매 catastrophic forget
Sample efficiency
매 high
매 low
Generality
✓ (cross-domain)
매 narrow → improving
Speed (perception)
ms
ms (inference)
Speed (math)
slow
매 fast
Memory
매 hierarchical
매 attention window
매 biological evolution 의 단계
Single cell (3.5 Bya): 매 chemotaxis (gradient).
Multicellular (1 Bya): 매 specialization.
Nervous system (650 Mya): 매 cnidaria.
Brain (550 Mya): 매 cambrian.
Mammal (200 Mya): 매 cortex.
Primate (65 Mya): 매 prefrontal.
Human (300 Kya): 매 language.
Modern human (50 Kya): 매 abstract reasoning.
매 brain 의 efficiency
Power: 매 20W ≈ 매 light bulb.
Synapse: 매 100 trillion.
Neuron: 매 86 billion.
Connection density: 매 sparse + 매 modular.
Spike: 매 sparse activation.
Plasticity: 매 STDP, Hebbian.
매 key biological mechanism
Neuron: 매 leaky integrate-and-fire.
Synapse: 매 chemical / electrical.
Plasticity: LTP / LTD, STDP.
Neurotransmitter: 매 dopamine, serotonin, glutamate.
Hebbian learning ("매 fire together, wire together")
defhebbian_update(W,pre,post,lr=0.01):"""매 Δw_ij = lr * pre_i * post_j."""returnW+lr*torch.outer(post,pre)
Predictive coding (Bayesian brain)
classPredictiveCodingLayer(nn.Module):"""매 top-down prediction + bottom-up error."""def__init__(self,dim):super().__init__()self.predictor=nn.Linear(dim,dim)defforward(self,top_down,bottom_up):prediction=self.predictor(top_down)error=bottom_up-predictionreturnerror# 매 error 만 의 propagate
Episodic memory (hippocampus-inspired)
classEpisodicBuffer:"""매 fast learning store."""def__init__(self,size=10000):self.size=sizeself.buffer=[]defstore(self,state,action,reward):iflen(self.buffer)>=self.size:self.buffer.pop(0)self.buffer.append((state,action,reward))defretrieve(self,query,k=10):# 매 nearest neighborscored=[(s,a,r,similarity(query,s))fors,a,rinself.buffer]returnsorted(scored,key=lambdax:-x[3])[:k]# 매 fast learning + slow consolidation (system 1 + 2).
Few-shot meta-learning (MAML)
defmaml_step(model,tasks,inner_lr=0.01,outer_lr=0.001):meta_loss=0fortaskintasks:# 매 inner: task-specificadapted=clone_model(model)forx,yintask.support:loss=F.cross_entropy(adapted(x),y)grads=torch.autograd.grad(loss,adapted.parameters())forp,ginzip(adapted.parameters(),grads):p.data-=inner_lr*g# 매 outer: metaforx,yintask.query:meta_loss+=F.cross_entropy(adapted(x),y)meta_loss.backward()optimizer.step()
Active inference (Friston)
defactive_inference(belief,action_space,world_model):"""매 expected free energy 의 minimize."""efe=[]forainaction_space:next_belief=world_model.predict(belief,a)info_gain=expected_info_gain(next_belief)pragmatic=expected_log_preference(next_belief)efe.append(-info_gain-pragmatic)returnaction_space[np.argmin(efe)]
🤔 결정 기준 (응용)
상황
Bio-inspiration
Edge inference
Spiking NN
Few-shot
Meta-learning + episodic
Robotics
Embodied + active inference
Continual
Replay + EWC
Energy budget
Neuromorphic chip
World model
Predictive coding
Sparse reward
Active inference
기본값: 매 specific bio-mechanism 의 isolate + 매 ML 의 integrate. 매 wholesale brain 의 mimic 의 X.
언제: 매 AI architecture 의 bio-inspire. 매 efficiency / few-shot 의 design. 매 embodied AI / robotics. 매 brain-AI fusion.
언제 X: 매 specific medical claim. 매 brain 의 literal mimic 의 expectation.
❌ 안티패턴
Brain literal mimic: 매 different paradigm.
Anthropomorphism: 매 LLM ≠ 매 conscious.
Embodied 의 ignore (robotics): 매 sim2real 의 fail.
Bigger = better assumption: 매 brain 의 sparse.
Single bio-feature 의 magic 의 expect: 매 system 의 emergent.