--- id: ML-LIN-REG-001 category: "10_Wiki/πŸ’‘ Topics/AI" confidence_score: 1.0 tags: [machine-learning, linear-regression, regression, supervised-learning, statistics] last_reinforced: 2026-04-26 --- # Linear Regression Mastery (μ„ ν˜• νšŒκ·€ λ§ˆμŠ€ν„°λ¦¬) ## πŸ“Œ ν•œ 쀄 톡찰 (The Karpathy Summary) > "λ°μ΄ν„°λ“€μ˜ λ³΅μž‘ν•œ 흩어짐 μ†μ—μ„œ λ³€μΉ˜ μ•ŠλŠ” 'λΉ„λ‘€μ˜ 법칙'을 μ°Ύμ•„λ‚΄μ–΄ 미래λ₯Ό νˆ¬μ˜ν•˜λΌ" β€” μž…λ ₯κ°’(Features)κ³Ό 좜λ ₯κ°’(Target) μ‚¬μ΄μ˜ 관계λ₯Ό κ°€μž₯ 잘 μ„€λͺ…ν•˜λŠ” 일차 방정식(직선 λ˜λŠ” μ΄ˆν‰λ©΄)을 μ°Ύμ•„λ‚΄λŠ” 지도 ν•™μŠ΅μ˜ κ·Όλ³Έ μ•Œκ³ λ¦¬μ¦˜. ## πŸ“– κ΅¬μ‘°ν™”λœ 지식 (Synthesized Content) - **μΆ”μΆœλœ νŒ¨ν„΄:** "Linear Approximation" β€” λ³€μˆ˜λ“€ κ°„μ˜ 관계가 μ„ ν˜•μ μ΄λΌλŠ” κ°€μ •ν•˜μ—, 였차의 μ œκ³±ν•©μ„ μ΅œμ†Œν™”ν•˜λŠ” 기울기(Weights)와 절편(Bias)을 κ΅¬ν•˜μ—¬ 연속적인 수치λ₯Ό μ˜ˆμΈ‘ν•˜λŠ” 수치 μΆ”λ‘  νŒ¨ν„΄. - **핡심 μš”μ†Œ:** - **Hypothesis:** $y = w_1x_1 + ... + w_nx_n + b$ ν˜•νƒœμ˜ 예츑 ν•¨μˆ˜. - **Cost Function:** μ˜ˆμΈ‘κ°’κ³Ό μ‹€μ œκ°’μ˜ 차이λ₯Ό μΈ‘μ •ν•˜λŠ” MSE(Mean Squared Error). - **Optimizer:** λΉ„μš© ν•¨μˆ˜λ₯Ό μ΅œμ†Œν™”ν•˜κΈ° μœ„ν•œ 경사 ν•˜κ°•λ²•(Gradient Descent) λ˜λŠ” μ •κ·œ 방정식. - **의의:** 결과에 λŒ€ν•œ 해석λ ₯이 맀우 λ›°μ–΄λ‚˜λ©°(Coefficients 뢄석), 인곡지λŠ₯이 데이터λ₯Ό 톡해 'ν•™μŠ΅'ν•œλ‹€λŠ” κ°œλ…μ„ μ΄ν•΄ν•˜κΈ° μœ„ν•œ κ°€μž₯ μ€‘μš”ν•œ 좜발점. ## ⚠️ λͺ¨μˆœ 및 μ—…λ°μ΄νŠΈ (Contradictions & RL Update) - **κ³Όκ±° λ°μ΄ν„°μ™€μ˜ 좩돌:** λ‹¨μˆœν•œ 직선 찾기둜 μΉ˜λΆ€λ˜κΈ°λ„ ν–ˆμœΌλ‚˜, μ •κ·œν™”(L1/L2)λ‚˜ λ‹€ν•­ νšŒκ·€(Polynomial) 등을 톡해 λ³΅μž‘ν•œ 데이터에도 μœ μ—°ν•˜κ²Œ λŒ€μ‘ν•˜λ©° ν˜„λŒ€ λ”₯λŸ¬λ‹ λ‰΄λŸ°μ˜ κΈ°λ³Έ λ‹¨μœ„λ‘œ κ³„μŠΉλ¨. - **μ •μ±… λ³€ν™”:** Antigravity ν”„λ‘œμ νŠΈλŠ” μ‹œμŠ€ν…œ λ¦¬μ†ŒμŠ€ μ‚¬μš©λŸ‰ 예츑 및 지식 κ°•ν™” μž‘μ—… μ†Œμš” μ‹œκ°„ μΆ”μ • μ‹œ, κ°€μž₯ 신뒰도 높은 해석을 μ œκ³΅ν•˜λŠ” μ„ ν˜• νšŒκ·€ λͺ¨λΈμ„ κΈ°λ³Έ μ§€ν‘œλ‘œ μ‚¬μš©ν•¨. ## πŸ”— 지식 μ—°κ²° (Graph) - [[Least-Squares-Methods|Least-Squares-Methods]], Gradient-Descent-Foundations, [[L1-and-L2-Regularization|L1-and-L2-Regularization]], [[Supervised-Learning-Foundations|Supervised-Learning-Foundations]] - **Raw Source:** 10_Wiki/Topics/AI/Linear-Regression-Mastery.md