--- id: NN-BASE-001 category: "10_Wiki/๐Ÿ’ก Topics/AI" confidence_score: 1.0 tags: [ai, deep-learning, neural-networks, foundations] last_reinforced: 2026-04-26 --- # Neural Networks Foundations (์‹ ๊ฒฝ๋ง ๊ธฐ์ดˆ) ## ๐Ÿ“Œ ํ•œ ์ค„ ํ†ต์ฐฐ (The Karpathy Summary) > "์ƒ๋ฌผํ•™์  ๋‡Œ๋ฅผ ๋ชจ๋ฐฉํ•œ ์ˆ˜ํ•™์  ์—ฐ์‚ฐ์˜ ์ง‘ํ•ฉ์ฒด" โ€” ๋‰ด๋Ÿฐ์˜ ํ™œ์„ฑํ™” ๊ตฌ์กฐ๋ฅผ ๋ชจ๋ฐฉํ•˜์—ฌ ์ž…๋ ฅ ๋ฐ์ดํ„ฐ์˜ ํŠน์ง•์„ ๋‹จ๊ณ„๋ณ„๋กœ ์ถ”์ถœํ•˜๊ณ  ๋น„์„ ํ˜•์ ์ธ ๊ด€๊ณ„๋ฅผ ํ•™์Šตํ•ด๋‚ด๋Š” ์ธ๊ณต์ง€๋Šฅ์˜ ํ•ต์‹ฌ ์•„ํ‚คํ…์ฒ˜. ## ๐Ÿ“– ๊ตฌ์กฐํ™”๋œ ์ง€์‹ (Synthesized Content) - **์ถ”์ถœ๋œ ํŒจํ„ด:** ๊ฐ€์ค‘์น˜(Weights)์™€ ํŽธํ–ฅ(Bias)์„ ๊ฐ€์ง„ ๋…ธ๋“œ๋“ค์ด ์ธต(Layer)์„ ์ด๋ฃจ์–ด ์—ฐ๊ฒฐ๋˜๊ณ , ํ™œ์„ฑํ™” ํ•จ์ˆ˜(Activation Function)๋ฅผ ํ†ตํ•ด ๋ณต์žกํ•œ ํ•จ์ˆ˜ ๊ด€๊ณ„๋ฅผ ๊ทผ์‚ฌ(Function Approximation)ํ•˜๋Š” ํŒจํ„ด. - **๊ธฐ๋ณธ ๊ตฌ์„ฑ ์š”์†Œ:** - **Perceptron:** ๋‹จ์ผ ๋‰ด๋Ÿฐ ๋ชจ๋ธ. ์ž…๋ ฅ๊ฐ’์— ๊ฐ€์ค‘์น˜๋ฅผ ๊ณฑํ•˜๊ณ  ํ•ฉ์‚ฐํ•œ ๋’ค ์ž„๊ณ„๊ฐ’์„ ๋„˜์œผ๋ฉด ํ™œ์„ฑํ™”. - **Layers:** ์ž…๋ ฅ์ธต(Input), ์€๋‹‰์ธต(Hidden), ์ถœ๋ ฅ์ธต(Output)์œผ๋กœ ๊ตฌ์„ฑ. ์€๋‹‰์ธต์ด ๋งŽ์•„์งˆ์ˆ˜๋ก '๋”ฅ๋Ÿฌ๋‹'์ด ๋จ. - **Activation Functions:** ReLU, Sigmoid, Tanh ๋“ฑ. ์‹ ๊ฒฝ๋ง์— ๋น„์„ ํ˜•์„ฑ์„ ๋ถ€์—ฌํ•˜์—ฌ ๋ณต์žกํ•œ ํŒจํ„ด ํ•™์Šต ๊ฐ€๋Šฅํ•˜๊ฒŒ ํ•จ. - **Forward Propagation:** ์ž…๋ ฅ์„ ๋ฐ›์•„ ์ถœ๋ ฅ์„ ๊ณ„์‚ฐํ•˜๋Š” ๊ณผ์ •. - **Backpropagation:** ์‹ค์ œ ๊ฐ’๊ณผ ์˜ˆ์ธก ๊ฐ’์˜ ์˜ค์ฐจ๋ฅผ ๋’ค๋กœ ์ „๋‹ฌํ•˜์—ฌ ๊ฐ€์ค‘์น˜๋ฅผ ์ˆ˜์ •ํ•˜๋Š” ํ•™์Šต ๊ณผ์ •. ## โš ๏ธ ๋ชจ์ˆœ ๋ฐ ์—…๋ฐ์ดํŠธ (Contradictions & RL Update) - **๊ณผ๊ฑฐ ๋ฐ์ดํ„ฐ์™€์˜ ์ถฉ๋Œ:** ๋‹จ์ˆœํ•œ ์„ ํ˜• ๋ถ„๋ฅ˜๊ธฐ์—์„œ, ๋ฒ”์šฉ ํ•จ์ˆ˜ ๊ทผ์‚ฌ์ž(Universal Function Approximator)๋กœ์„œ์˜ ์ง€์œ„๋ฅผ ํ™•๋ณดํ•˜๋ฉฐ ๋ชจ๋“  ํ˜„๋Œ€ AI ๊ธฐ์ˆ ์˜ ๋ฟŒ๋ฆฌ๊ฐ€ ๋จ. - **์ •์ฑ… ๋ณ€ํ™”:** Antigravity ํ”„๋กœ์ ํŠธ๋Š” ์‹ ๊ฒฝ๋ง์˜ ๊ธฐ๋ณธ ์›๋ฆฌ๋ฅผ ๋ฐ”ํƒ•์œผ๋กœ ํ•˜๋˜, ๋ฐ์ดํ„ฐ ํšจ์œจ์„ฑ์„ ์œ„ํ•ด ์ƒ์œ„ ์ˆ˜์ค€์˜ ์ธ์ง€ ํ”„๋ ˆ์ž„์›Œํฌ์™€ ๊ฒฐํ•ฉํ•˜์—ฌ ์‚ฌ์šฉํ•จ. ## ๐Ÿ”— ์ง€์‹ ์—ฐ๊ฒฐ (Graph) - [[Deep-Learning]], Artificial-Neural-Networks, [[Gradient-Descent]], [[Backpropagation]] - **Raw Source:** 10_Wiki/Topics/AI/Neural-Networks (์‹ ๊ฒฝ๋ง ๊ธฐ์ดˆ).md