--- id: DL-MLP-001 category: "10_Wiki/๐Ÿ’ก Topics/AI" confidence_score: 1.0 tags: [ai, deep-learning, mlp, neural-networks, backpropagation, foundations] last_reinforced: 2026-04-26 --- # Multilayer Perceptron (MLP, ๋‹ค์ธต ํผ์…‰ํŠธ๋ก ) ## ๐Ÿ“Œ ํ•œ ์ค„ ํ†ต์ฐฐ (The Karpathy Summary) > "๋‹จ์ˆœํ•œ ์„ ํ˜•์  ํŒ๋‹จ์„ ๋„˜์–ด, ๋น„์„ ํ˜•์˜ ์ธต(Hidden Layers)์„ ์Œ“์•„ ์„ธ์ƒ์˜ ๋ณต์žกํ•œ ๋น„๋…ผ๋ฆฌ๋ฅผ ๋…ผ๋ฆฌ์ ์œผ๋กœ ํ•ด์ฒดํ•˜๋ผ" โ€” ์—ฌ๋Ÿฌ ๊ฐœ์˜ ํผ์…‰ํŠธ๋ก  ๋ ˆ์ด์–ด๋ฅผ ์Œ“๊ณ  ๋น„์„ ํ˜• ํ™œ์„ฑํ™” ํ•จ์ˆ˜๋ฅผ ๊ฒฐํ•ฉํ•˜์—ฌ ์ž„์˜์˜ ๋ณต์žกํ•œ ํ•จ์ˆ˜๋ฅผ ๊ทผ์‚ฌํ•  ์ˆ˜ ์žˆ๋Š” ๊ฐ€์žฅ ๊ธฐ๋ณธ์ ์ธ ์‹ฌ์ธต ์‹ ๊ฒฝ๋ง ๊ตฌ์กฐ. ## ๐Ÿ“– ๊ตฌ์กฐํ™”๋œ ์ง€์‹ (Synthesized Content) - **์ถ”์ถœ๋œ ํŒจํ„ด:** "Hierarchical Feature Extraction" โ€” ์ž…๋ ฅ ๋ฐ์ดํ„ฐ๋ฅผ ์€๋‹‰์ธต์„ ๊ฑฐ์น˜๋ฉฐ ๋” ์ถ”์ƒ์ ์ด๊ณ  ๊ณ ์ฐจ์›์ ์ธ ํŠน์ง•์œผ๋กœ ๋ณ€ํ™˜ํ•˜์—ฌ, ์„ ํ˜• ๋ถ„๋ฆฌ๊ฐ€ ๋ถˆ๊ฐ€๋Šฅํ•œ ๋ณต์žกํ•œ ๊ฒฝ๊ณ„๋ฉด์„ ํ•™์Šตํ•˜๋Š” ๋”ฅ๋Ÿฌ๋‹์˜ ์›ํ˜•์  ํŒจํ„ด. - **ํ•ต์‹ฌ ๊ตฌ์„ฑ:** - **Input Layer:** ์™ธ๋ถ€ ๋ฐ์ดํ„ฐ๋ฅผ ์ˆ˜์šฉํ•˜๋Š” ๊ด€๋ฌธ. - **Hidden Layers:** ๋ฐ์ดํ„ฐ์˜ ์ˆจ๊ฒจ์ง„ ํŒจํ„ด์„ ์ถ”์ถœํ•˜๋Š” ๋น„์„ ํ˜• ์—ฐ์‚ฐ ์ธต. - **Output Layer:** ์ตœ์ข… ํŒ๋‹จ ๊ฒฐ๊ณผ๋ฅผ ๋‚ด๋†“๋Š” ์ธต. - **Fully Connected:** ๋ชจ๋“  ๋‰ด๋Ÿฐ์ด ์ด์ „ ์ธต์˜ ๋ชจ๋“  ๋‰ด๋Ÿฐ๊ณผ ์—ฐ๊ฒฐ๋œ ๊ตฌ์กฐ. - **์˜์˜:** ํผ์…‰ํŠธ๋ก ์˜ ํ•œ๊ณ„(XOR ๋ฌธ์ œ)๋ฅผ ๊ทน๋ณตํ•˜๊ณ  ์—ญ์ „ํŒŒ(Backpropagation) ์•Œ๊ณ ๋ฆฌ์ฆ˜๊ณผ ๊ฒฐํ•ฉํ•˜์—ฌ ํ˜„๋Œ€ ์ธ๊ณต์‹ ๊ฒฝ๋ง์˜ ๋ถ€ํฅ์„ ์ด๋ˆ ๊ฒฐ์ •์  ํ† ๋Œ€. ## โš ๏ธ ๋ชจ์ˆœ ๋ฐ ์—…๋ฐ์ดํŠธ (Contradictions & RL Update) - **๊ณผ๊ฑฐ ๋ฐ์ดํ„ฐ์™€์˜ ์ถฉ๋Œ:** MLP๋งŒ์œผ๋กœ ๋ชจ๋“  ๋ฐ์ดํ„ฐ๋ฅผ ์ฒ˜๋ฆฌํ•˜๋ ค๋˜ ๋ฐฉ์‹์—์„œ, ๋ฐ์ดํ„ฐ์˜ ํŠน์„ฑ์— ์ตœ์ ํ™”๋œ CNN(์ด๋ฏธ์ง€)์ด๋‚˜ RNN/Transformer(์–ธ์–ด) ๋“ฑ์œผ๋กœ ์ „๋ฌธํ™”๋˜์—ˆ์œผ๋‚˜, ์—ฌ์ „ํžˆ ๋ชจ๋“  ๋ชจ๋ธ์˜ ๋งˆ์ง€๋ง‰ ์˜์‚ฌ๊ฒฐ์ • ๋ ˆ์ด์–ด(Classification Head)์—๋Š” MLP ๊ตฌ์กฐ๊ฐ€ ํ•ต์‹ฌ์ ์œผ๋กœ ์‚ฌ์šฉ๋จ. - **์ •์ฑ… ๋ณ€ํ™”:** Antigravity ํ”„๋กœ์ ํŠธ๋Š” ์—์ด์ „ํŠธ์˜ ์ƒํ™ฉ ํŒ๋‹จ ๋ชจ๋“ˆ์ด๋‚˜ ๊ฐ€๋ฒผ์šด ํŠน์ง• ๋ถ„๋ฅ˜๊ธฐ ์„ค๊ณ„ ์‹œ, ๊ตฌ์กฐ์  ๋‹จ์ˆœํ•จ๊ณผ ๋ฒ”์šฉ์„ฑ์„ ๊ฐ–์ถ˜ MLP ์•„ํ‚คํ…์ฒ˜๋ฅผ ์šฐ์„ ์ ์œผ๋กœ ํ™œ์šฉํ•จ. ## ๐Ÿ”— ์ง€์‹ ์—ฐ๊ฒฐ (Graph) - Deep-Learning-Foundations, Backpropagation-Foundations, Activation-Functions, Softmax-Regression-and-Classification - **Raw Source:** 10_Wiki/Topics/AI/Multilayer-Perceptron-MLP.md