--- id: BOLTZMANN-001 category: "10_Wiki/πŸ’‘ Topics/AI" confidence_score: 1.0 tags: [ai, deep-learning, neural-networks, energy-based-model, statistical-mechanics] last_reinforced: 2026-04-26 --- # Boltzmann Machines (볼츠만 λ¨Έμ‹ ) ## πŸ“Œ ν•œ 쀄 톡찰 (The Karpathy Summary) > "λ°μ΄ν„°μ˜ 뢄포λ₯Ό 물리적인 μ—λ„ˆμ§€ ν‰ν˜• μƒνƒœλ‘œ λͺ¨λΈλ§ν•˜λΌ" β€” ν†΅κ³„μ—­ν•™μ˜ 볼츠만 λΆ„ν¬μ—μ„œ μ˜κ°μ„ μ–»μ–΄, μ‹ κ²½λ§μ˜ 전역적 μ—λ„ˆμ§€ μƒνƒœλ₯Ό μ΅œμ†Œν™”ν•˜λŠ” λ°©ν–₯으둜 ν•™μŠ΅ν•˜μ—¬ λ°μ΄ν„°μ˜ ꡬ쑰λ₯Ό νŒŒμ•…ν•˜λŠ” ν™•λ₯ μ  μž¬κ·€ 신경망. ## πŸ“– κ΅¬μ‘°ν™”λœ 지식 (Synthesized Content) - **μΆ”μΆœλœ νŒ¨ν„΄:** κ°€μ‹œ λ…Έλ“œμ™€ 은닉 λ…Έλ“œ κ°„μ˜ μƒν˜Έμž‘μš©μ„ 톡해 λ°μ΄ν„°μ˜ λ³΅μž‘ν•œ 상관관계λ₯Ό ν™•λ₯  뢄포 ν˜•νƒœλ‘œ ν•™μŠ΅ν•˜κ³  μƒμ„±ν•˜λŠ” μ—λ„ˆμ§€ 기반(Energy-based) ν•™μŠ΅ νŒ¨ν„΄. - **μ£Όμš” μœ ν˜•:** - **RBM (Restricted Boltzmann Machine):** 같은 측의 λ…Έλ“œ κ°„ 연결을 μ œν•œν•˜μ—¬ ν•™μŠ΅ νš¨μœ¨μ„ 높인 λͺ¨λΈ. λ”₯λŸ¬λ‹ 초기 κ°€μ€‘μΉ˜ μ΄ˆκΈ°ν™”(Pre-training)에 κΈ°μ—¬. - **Deep Boltzmann Machine (DBM):** μ—¬λŸ¬ 측의 RBM을 μŒ“μ•„ 올렀 더 λ³΅μž‘ν•œ νŠΉμ§• ν•™μŠ΅. - **ν•™μŠ΅ 원리:** μ‹€μ œ λ°μ΄ν„°μ˜ 뢄포와 λͺ¨λΈμ΄ μƒμ„±ν•œ 뢄포 μ‚¬μ΄μ˜ 차이(KL-Divergence)λ₯Ό μ΅œμ†Œν™”. ## ⚠️ λͺ¨μˆœ 및 μ—…λ°μ΄νŠΈ (Contradictions & RL Update) - **κ³Όκ±° λ°μ΄ν„°μ™€μ˜ 좩돌:** 초기 λ”₯λŸ¬λ‹μ˜ λΆ€ν™œμ„ 이끈 핡심 기술(DBN λ“±)μ΄μ—ˆμœΌλ‚˜, ν˜„μž¬λŠ” μ—­μ „νŒŒ(Backprop) 기술의 λ°œλ‹¬κ³Ό ReLU λ“±μ˜ λ“±μž₯으둜 인해 μ£Όλ₯˜μ—μ„œλŠ” λ‹€μ†Œ λ¬ΌλŸ¬λ‚œ μƒνƒœμž„. - **μ •μ±… λ³€ν™”:** Antigravity ν”„λ‘œμ νŠΈλŠ” 비지도 ν•™μŠ΅ 기반의 νŠΉμ§• μΆ”μΆœ μ•Œκ³ λ¦¬μ¦˜ 연ꡬ μ‹œ, 볼츠만 λ¨Έμ‹ μ˜ μ—λ„ˆμ§€ 기반 λͺ¨λΈλ§ 철학을 μ°Έκ³ ν•˜μ—¬ 데이터 정합성을 검증함. ## πŸ”— 지식 μ—°κ²° (Graph) - Unsupervised-Learning-Foundations, Energy-Based-Models, [[Deep-Learning|Deep-Learning]], Statistical-Mechanics - **Raw Source:** 10_Wiki/Topics/AI/Boltzmann-Machines.md