--- id: GAUSS-001 category: "[[10_Wiki/πŸ’‘ Topics/AI]]" confidence_score: 1.0 tags: [machine-learning, statistics, bayesian, regression] last_reinforced: 2026-04-26 --- # [[Gaussian Processes (κ°€μš°μŠ€ κ³Όμ •)]] ## πŸ“Œ ν•œ 쀄 톡찰 (The Karpathy Summary) > "ν•¨μˆ˜λ“€μ˜ ν™•λ₯  뢄포λ₯Ό μ •μ˜ν•˜λΌ" β€” μœ ν•œν•œ μƒ˜ν”Œ 데이터λ₯Ό λ°”νƒ•μœΌλ‘œ λ―Έμ§€μ˜ ν•¨μˆ˜ κ°’λΏλ§Œ μ•„λ‹ˆλΌ κ·Έ κ°’μ˜ λΆˆν™•μ‹€μ„±(Confidence)κΉŒμ§€ λ™μ‹œμ— μ˜ˆμΈ‘ν•˜λŠ” λΉ„λͺ¨μˆ˜μ  λ² μ΄μ§€μ•ˆ 회둜 λͺ¨λΈ. ## πŸ“– κ΅¬μ‘°ν™”λœ 지식 (Synthesized Content) - **μΆ”μΆœλœ νŒ¨ν„΄:** μž…λ ₯ κ³΅κ°„μ˜ μ–΄λ–€ μ λ“€μ˜ 집합에 λŒ€ν•΄μ„œλ„ κ°€μš°μŠ€ 뢄포(μ •κ·œ 뢄포)λ₯Ό λ”°λ₯Έλ‹€κ³  κ°€μ •ν•˜κ³ , 데이터 κ°„μ˜ μœ μ‚¬λ„(Kernel)λ₯Ό μ •μ˜ν•˜μ—¬ ν•¨μˆ˜μ˜ 흐름을 μΆ”λ‘ ν•˜λŠ” νŒ¨ν„΄. - **μ„ΈλΆ€ λ‚΄μš©:** - **Kernel Function (Covariance):** 두 지점이 μ–Όλ§ˆλ‚˜ μœ μ‚¬ν•œ 행동을 보일지 μ •μ˜ (예: RBF 컀널). λͺ¨λΈμ˜ μœ μ—°μ„±μ„ κ²°μ •. - **Mean & Variance:** μ˜ˆμΈ‘κ°’λΏλ§Œ μ•„λ‹ˆλΌ κ·Έ μ§€μ μ—μ„œμ˜ 였차 λ²”μœ„(λΆˆν™•μ‹€μ„±)λ₯Ό ν•¨κ»˜ 좜λ ₯함. - **Bayesian Inference:** μƒˆλ‘œμš΄ 데이터가 λ“€μ–΄μ˜¬ λ•Œλ§ˆλ‹€ 사후 뢄포(Posterior)λ₯Ό μ—…λ°μ΄νŠΈν•˜μ—¬ λͺ¨λΈμ„ 정ꡐ화. - **Non-parametric:** 데이터가 λŠ˜μ–΄λ‚ μˆ˜λ‘ λͺ¨λΈμ˜ λ³΅μž‘λ„κ°€ μžλ™μœΌλ‘œ μ μ‘ν•˜λ©°, νŒŒλΌλ―Έν„° κ°œμˆ˜κ°€ κ³ μ •λ˜μ–΄ μžˆμ§€ μ•ŠμŒ. ## ⚠️ λͺ¨μˆœ 및 μ—…λ°μ΄νŠΈ (Contradictions & RL Update) - **κ³Όκ±° λ°μ΄ν„°μ™€μ˜ 좩돌:** 데이터가 λ§Žμ•„μ§ˆμˆ˜λ‘ μ—°μ‚° λΉ„μš©($O(N^3)$)이 κΈ‰μ¦ν•˜λŠ” ν•œκ³„κ°€ μžˆμ—ˆμœΌλ‚˜, μ΅œκ·Όμ—λŠ” ν¬μ†Œ κ°€μš°μŠ€ κ³Όμ •(Sparse GP) λ“±μ˜ κΈ°λ²•μœΌλ‘œ λŒ€κ·œλͺ¨ 데이터 처리 κ°€λŠ₯해짐. - **μ •μ±… λ³€ν™”:** AI μ—μ΄μ „νŠΈμ˜ ν•˜μ΄νΌνŒŒλΌλ―Έν„° μ΅œμ ν™”(Bayesian Optimization) κ³Όμ •μ—μ„œ 탐색과 ν™œμš©μ˜ κ· ν˜•μ„ λ§žμΆ”κΈ° μœ„ν•œ 핡심 μ•Œκ³ λ¦¬μ¦˜μœΌλ‘œ μ‚¬μš©λ¨. ## πŸ”— 지식 μ—°κ²° (Graph) - [[Bayesian-Inference]], [[Regression-Analysis]], [[Kernel-Methods]], [[Optimization]] - **Raw Source:** [[10_Wiki/Topics/AI/Gaussian-Processes.md]]