--- id: MATH-GP-001 category: "10_Wiki/πŸ’‘ Topics/AI" confidence_score: 1.0 tags: [statistics, machine-learning, gaussian-processes, bayesian-inference, uncertainty] last_reinforced: 2026-04-26 --- # Gaussian Processes (κ°€μš°μ‹œμ•ˆ ν”„λ‘œμ„ΈμŠ€) ## πŸ“Œ ν•œ 쀄 톡찰 (The Karpathy Summary) > "데이터λ₯Ό μ§€λ‚˜λŠ” λ¬΄ν•œνžˆ λ§Žμ€ ν•¨μˆ˜λ“€μ˜ 뢄포λ₯Ό μ •μ˜ν•˜κ³ , κ°€μž₯ κ°€λŠ₯μ„± 높은 κΈΈκ³Ό κ·Έ 확신도λ₯Ό κ³„μ‚°ν•˜λΌ" β€” ν•¨μˆ˜ 자체λ₯Ό λ¬΄ν•œ μ°¨μ›μ˜ κ°€μš°μ‹œμ•ˆ λΆ„ν¬λ‘œ μ·¨κΈ‰ν•˜μ—¬, μ–΄λ–€ μž…λ ₯에 λŒ€ν•œ 좜λ ₯값을 평균과 ν‘œμ€€νŽΈμ°¨λ₯Ό κ°€μ§„ ν™•λ₯  λΆ„ν¬λ‘œ μ œκ³΅ν•˜λŠ” κ°•λ ₯ν•œ νšŒκ·€ 및 λΆ„λ₯˜ 도ꡬ. ## πŸ“– κ΅¬μ‘°ν™”λœ 지식 (Synthesized Content) - **μΆ”μΆœλœ νŒ¨ν„΄:** μž…λ ₯ 데이터 κ°„μ˜ μœ μ‚¬μ„±μ„ 컀널 ν•¨μˆ˜(Kernel Function)둜 μ •μ˜ν•˜κ³ , κ°€κΉŒμš΄ 지점은 λΉ„μŠ·ν•œ 값을 κ°€μ§ˆ κ²ƒμ΄λΌλŠ” λ―ΏμŒμ„ λ°”νƒ•μœΌλ‘œ λ―Έμ§€μ˜ μ˜μ—­μ„ μΆ”λ‘ ν•˜λŠ” λ² μ΄μ§€μ•ˆ λΉ„λͺ¨μˆ˜ νŒ¨ν„΄. - **핡심 μš”μ†Œ:** - **Mean Function:** 데이터가 없을 λ•Œμ˜ κΈ°λ³Έ μ˜ˆμΈ‘κ°’ (보톡 0). - **Kernel (Covariance) Function:** 두 μž…λ ₯ μ‚¬μ΄μ˜ 관계(λΆ€λ“œλŸ¬μ›€, μ£ΌκΈ°μ„± λ“±)λ₯Ό κ²°μ •ν•˜λŠ” 핡심 νŒŒλΌλ―Έν„°. - **Bayesian Inference:** μƒˆλ‘œμš΄ κ΄€μΈ‘ 데이터가 μœ μž…λ  λ•Œλ§ˆλ‹€ 사후 뢄포(Posterior)λ₯Ό μ—…λ°μ΄νŠΈν•˜μ—¬ λΆˆν™•μ‹€μ„± μ •μ œ. - **의의:** λ”₯λŸ¬λ‹κ³Ό 달리 λͺ¨λΈμ˜ 'λͺ¨λ¦„(Uncertainty)'을 μ •λŸ‰ν™”ν•  수 μžˆμ–΄, μ΅œμ ν™”(Bayesian Optimization)λ‚˜ μ†ŒλŸ‰ 데이터 ν•™μŠ΅μ—μ„œ ν•„μˆ˜μ μœΌλ‘œ μ‚¬μš©λ¨. ## ⚠️ λͺ¨μˆœ 및 μ—…λ°μ΄νŠΈ (Contradictions & RL Update) - **κ³Όκ±° λ°μ΄ν„°μ™€μ˜ 좩돌:** μ—°μ‚° λ³΅μž‘λ„κ°€ 데이터 수의 μ„Έμ œκ³±($O(n^3)$)에 λΉ„λ‘€ν•˜μ—¬ λŒ€κ·œλͺ¨ 데이터 μ²˜λ¦¬κ°€ λΆˆκ°€λŠ₯ν–ˆμœΌλ‚˜, μ΅œκ·Όμ—λŠ” ν¬μ†Œ 근사(Sparse approximation) 기법을 톡해 수백만 개의 데이터도 처리 κ°€λŠ₯ν•˜λ„λ‘ μ§„ν™”. - [[Epistemic-Uncertainty|Epistemic-Uncertainty]]λ₯Ό μ •λ°€ν•˜κ²Œ μΈ‘μ •ν•˜λŠ” 데 κ°€μž₯ μ ν•©ν•œ λ„κ΅¬λ‘œ μž¬ν‰κ°€λ¨. ## πŸ”— 지식 μ—°κ²° (Graph) - [[Epistemic-Uncertainty|Epistemic-Uncertainty]], Bayesian-Inference, [[Black-Box-Optimization|Black-Box-Optimization]], Regression-Foundations - **Raw Source:** 10_Wiki/Topics/AI/Gaussian-Processes.md