--- id: ML-LOG-REG-001 category: "10_Wiki/๐Ÿ’ก Topics/AI" confidence_score: 1.0 tags: [machine-learning, logistic-regression, classification, supervised-learning, sigmoid] last_reinforced: 2026-04-26 --- # Logistic Regression Foundations (๋กœ์ง€์Šคํ‹ฑ ํšŒ๊ท€ ๊ธฐ์ดˆ) ## ๐Ÿ“Œ ํ•œ ์ค„ ํ†ต์ฐฐ (The Karpathy Summary) > "์„ธ์ƒ์˜ ๋ชจ๋“  ์งˆ๋ฌธ์„ '์˜ˆ(1)' ํ˜น์€ '์•„๋‹ˆ์˜ค(0)'์˜ ํ™•๋ฅ ๋กœ ๋ณ€ํ™˜ํ•˜์—ฌ, ๋ชจํ˜ธํ•จ์˜ ๊ฒฝ๊ณ„์— ๋ช…ํ™•ํ•œ ์„ ์„ ๊ทธ์–ด๋ผ" โ€” ์„ ํ˜• ํšŒ๊ท€์˜ ์ถœ๋ ฅ๊ฐ’์„ ์‹œ๊ทธ๋ชจ์ด๋“œ(Sigmoid) ํ•จ์ˆ˜๋ฅผ ํ†ตํ•ด 0๊ณผ 1 ์‚ฌ์ด์˜ ํ™•๋ฅ ๋กœ ๋ณ€ํ™˜ํ•˜์—ฌ ์ด์ง„ ๋ถ„๋ฅ˜ ๋ฌธ์ œ๋ฅผ ํ•ด๊ฒฐํ•˜๋Š” ๊ฐ€์žฅ ๊ธฐ๋ณธ์ ์ด๊ณ  ๊ฐ•๋ ฅํ•œ ์•Œ๊ณ ๋ฆฌ์ฆ˜. ## ๐Ÿ“– ๊ตฌ์กฐํ™”๋œ ์ง€์‹ (Synthesized Content) - **์ถ”์ถœ๋œ ํŒจํ„ด:** "Probabilistic Binary Classification" โ€” ์„ ํ˜• ๊ฒฐํ•ฉ($z = wx + b$)์˜ ๊ฒฐ๊ณผ๋ฅผ ํ™•๋ฅ  ๊ณต๊ฐ„($0 \le p \le 1$)์œผ๋กœ ๋งคํ•‘ํ•˜๊ณ , ์ž„๊ณ„๊ฐ’(Threshold)์„ ๊ธฐ์ค€์œผ๋กœ ๋ฐ์ดํ„ฐ๋ฅผ ๋‘ ์ง‘๋‹จ์œผ๋กœ ๋‚˜๋ˆ„๋Š” ํ™•๋ฅ  ๊ธฐ๋ฐ˜ ๋ถ„๋ฅ˜ ํŒจํ„ด. - **ํ•ต์‹ฌ ์š”์†Œ:** - **Sigmoid Function:** ์–ด๋–ค ์‹ค์ˆ˜๊ฐ’์ด๋“  0๊ณผ 1 ์‚ฌ์ด๋กœ ์••์ถ•ํ•˜๋Š” ๋น„์„ ํ˜• ํ•จ์ˆ˜. - **Decision Boundary:** ํ™•๋ฅ  0.5๋ฅผ ๊ธฐ์ค€์œผ๋กœ ํด๋ž˜์Šค๋ฅผ ๊ฐ€๋ฅด๋Š” ๊ฒฝ๊ณ„์„ . - **Binary Cross-Entropy Loss:** ์˜ˆ์ธก ํ™•๋ฅ ๊ณผ ์‹ค์ œ ๋ ˆ์ด๋ธ” ์‚ฌ์ด์˜ ์˜ค์ฐจ๋ฅผ ์ธก์ •ํ•˜๋Š” ์†์‹ค ํ•จ์ˆ˜. - **์˜์˜:** ์ŠคํŒธ ๋ฉ”์ผ ๋ถ„๋ฅ˜, ์งˆ๋ณ‘ ์œ ๋ฌด ํŒ๋ณ„ ๋“ฑ ์ˆ˜๋งŽ์€ ์ด์ง„ ๋ถ„๋ฅ˜ ๋ฌธ์ œ์˜ ํ‘œ์ค€ ๋ชจ๋ธ์ด๋ฉฐ, ๋”ฅ๋Ÿฌ๋‹ ๋‰ด๋Ÿฐ์˜ ๋™์ž‘ ์›๋ฆฌ๋ฅผ ์ดํ•ดํ•˜๋Š” ํ•ต์‹ฌ ๊ฐ€๊ต ์—ญํ• . ## โš ๏ธ ๋ชจ์ˆœ ๋ฐ ์—…๋ฐ์ดํŠธ (Contradictions & RL Update) - **๊ณผ๊ฑฐ ๋ฐ์ดํ„ฐ์™€์˜ ์ถฉ๋Œ:** ์ด๋ฆ„์€ 'ํšŒ๊ท€(Regression)'์ด์ง€๋งŒ ์‹ค์ œ๋กœ๋Š” '๋ถ„๋ฅ˜(Classification)'์— ์‚ฌ์šฉ๋œ๋‹ค๋Š” ์ ์ด ์ดˆ์‹ฌ์ž์—๊ฒŒ ํ˜ผ๋ž€์„ ์ฃผ๋‚˜, ์ถœ๋ ฅ๊ฐ’์ด ํ™•๋ฅ ์ด๋ผ๋Š” ์—ฐ์†์ ์ธ ์ˆ˜์น˜๋ผ๋Š” ์ ์—์„œ ํ†ต๊ณ„ํ•™์  ํšŒ๊ท€์˜ ๋ฒ”์ฃผ์— ํฌํ•จ๋จ์„ ์ดํ•ดํ•˜๋Š” ๊ฒƒ์ด ์ค‘์š”. - **์ •์ฑ… ๋ณ€ํ™”:** Antigravity ํ”„๋กœ์ ํŠธ๋Š” ์—์ด์ „ํŠธ์˜ ํŠน์ • ํ–‰๋™ ์ˆ˜ํ–‰ ์—ฌ๋ถ€(Success/Fail)๋ฅผ ์˜ˆ์ธกํ•˜๋Š” ๊ฐ€๋ฒผ์šด ํŒ๋‹จ ๋ชจ๋“ˆ ์„ค๊ณ„ ์‹œ, ์—ฐ์‚ฐ ํšจ์œจ์ด ๊ทน๋Œ€ํ™”๋œ ๋กœ์ง€์Šคํ‹ฑ ํšŒ๊ท€๋ฅผ ์šฐ์„ ์ ์œผ๋กœ ๊ณ ๋ คํ•จ. ## ๐Ÿ”— ์ง€์‹ ์—ฐ๊ฒฐ (Graph) - [[Linear-Regression-Mastery|Linear-Regression-Mastery]], Deep-Learning-Foundations, [[Loss-Functions-Foundations|Loss-Functions-Foundations]], [[Supervised-Learning-Foundations|Supervised-Learning-Foundations]] - **Raw Source:** 10_Wiki/Topics/AI/Logistic-Regression-Foundations.md