--- id: ML-NPAR-001 category: "10_Wiki/πŸ’‘ Topics/AI" confidence_score: 1.0 tags: [machine-learning, statistics, non-parametric, knn, decision-trees, data-driven] last_reinforced: 2026-04-26 --- # Non-parametric Models (λΉ„λͺ¨μˆ˜ λͺ¨λΈ) ## πŸ“Œ ν•œ 쀄 톡찰 (The Karpathy Summary) > "λ°μ΄ν„°μ˜ ν˜•μƒμ„ 미리 μ§μž‘ν•˜μ—¬ 가두지 말고, 데이터 μŠ€μŠ€λ‘œκ°€ μžμ‹ μ˜ ꡬ쑰λ₯Ό λ“œλŸ¬λ‚΄κ²Œ ν•˜λΌ" β€” κ³ μ •λœ 수의 λ§€κ°œλ³€μˆ˜λ₯Ό κ°€μ§€μ§€ μ•Šκ³ , λ°μ΄ν„°μ˜ 규λͺ¨μ— 따라 λͺ¨λΈμ˜ λ³΅μž‘λ„κ°€ μœ μ—°ν•˜κ²Œ λ³€ν™”ν•˜λŠ” λ¨Έμ‹ λŸ¬λ‹ μ•Œκ³ λ¦¬μ¦˜ 체계. ## πŸ“– κ΅¬μ‘°ν™”λœ 지식 (Synthesized Content) - **μΆ”μΆœλœ νŒ¨ν„΄:** "Instance-based and Flexible Representation" β€” 데이터λ₯Ό μ„ ν˜•μ΄λ‚˜ μ •κ·œ 뢄포와 같은 νŠΉμ • μˆ˜μ‹μœΌλ‘œ μš”μ•½ν•˜λŠ” λŒ€μ‹ , 데이터 포인트 κ·Έ 자체λ₯Ό κΈ°μ–΅ν•˜κ±°λ‚˜(K-NN) μ˜μ—­μ„ 잘게 μͺΌκ°œμ–΄(Decision Trees) λ³΅μž‘ν•˜κ³  λΆˆκ·œμΉ™ν•œ λ°μ΄ν„°μ˜ 경계면을 μžˆλŠ” κ·ΈλŒ€λ‘œ ν•™μŠ΅ν•˜λŠ” νŒ¨ν„΄. - **μ£Όμš” νŠΉμ§•:** - **Flexibility:** λ°μ΄ν„°μ˜ 뢄포에 λŒ€ν•΄ κ°•ν•œ 가정을 ν•˜μ§€ μ•ŠμœΌλ―€λ‘œ 맀우 μœ μ—°ν•¨. - **Model Complexity:** λ°μ΄ν„°μ…‹μ˜ 크기가 컀질수둝 ν•„μš”ν•œ λ§€κ°œλ³€μˆ˜λ‚˜ μ €μž₯ μš©λŸ‰λ„ λΉ„λ‘€ν•΄μ„œ 증가함. - **Overfitting Risk:** λ°μ΄ν„°μ˜ λ…Έμ΄μ¦ˆκΉŒμ§€ ν•™μŠ΅ν•  μœ„ν—˜μ΄ μžˆμ–΄ μ μ ˆν•œ κ·œμ œκ°€ ν•„μˆ˜μ μž„. - **의의:** λ°μ΄ν„°μ˜ νŒ¨ν„΄μ΄ 맀우 λ³΅μž‘ν•˜κ±°λ‚˜ 사전 지식이 λΆ€μ‘±ν•œ λ„λ©”μΈμ—μ„œ, κ³ μ •λœ μ„ ν˜• λͺ¨λΈλ³΄λ‹€ 훨씬 높은 적응λ ₯을 λ°œνœ˜ν•¨. ## ⚠️ λͺ¨μˆœ 및 μ—…λ°μ΄νŠΈ (Contradictions & RL Update) - **κ³Όκ±° λ°μ΄ν„°μ™€μ˜ 좩돌:** λΉ„λͺ¨μˆ˜ λͺ¨λΈμ€ λ§€κ°œλ³€μˆ˜κ°€ 'μ—†λ‹€'λŠ” 뜻이 μ•„λ‹ˆλΌ, κ·Έ μˆ˜κ°€ κ³ μ •λ˜μ§€ μ•Šμ•˜μŒμ„ μ˜λ―Έν•¨. μ΅œκ·Όμ—λŠ” κ°€μš°μ‹œμ•ˆ ν”„λ‘œμ„ΈμŠ€(Gaussian Processes)λ‚˜ λ² μ΄μ§€μ•ˆ λΉ„λͺ¨μˆ˜ λͺ¨λΈ 등을 톡해 λΆˆν™•μ‹€μ„±κΉŒμ§€ μ •λ°€ν•˜κ²Œ μΈ‘μ •ν•˜λŠ” λ°©ν–₯으둜 고도화됨. - **μ •μ±… λ³€ν™”:** Antigravity ν”„λ‘œμ νŠΈλŠ” μ—μ΄μ „νŠΈμ˜ μž‘μ—… μ†Œμš” μ‹œκ°„ μ˜ˆμΈ‘μ΄λ‚˜ 이상 탐지(Anomaly Detection) μ‹œ, λ°μ΄ν„°μ˜ 뢄포λ₯Ό 미리 μ˜ˆλ‹¨ν•˜μ§€ μ•ŠκΈ° μœ„ν•΄ λΉ„λͺ¨μˆ˜μ  접근법인 컀널 밀도 μΆ”μ •(KDE)μ΄λ‚˜ 랜덀 포레슀트λ₯Ό 적극 ν™œμš©ν•¨. ## πŸ”— 지식 μ—°κ²° (Graph) - [[K-Nearest-Neighbors-K-NN]], Decision-Trees-and-Random-Forests, Support-Vector-Machines-SVM, [[Instance-based-Learning]] - **Raw Source:** 10_Wiki/Topics/AI/Non-parametric-Models.md