--- id: [[P-Reinforce]]-AI-DIMINISHING-RETURNS category: "10_Wiki/๐Ÿ’ก Topics/AI" confidence_score: 0.98 tags: [Economics,[[ system]]s, [[Optimization]], [[Efficiency]]] last_reinforced: 2026-04-20 --- # [[Diminishing Returns (ํ•œ๊ณ„ ์ˆ˜์ต ์ฒด๊ฐ)]] ## ๐Ÿ“Œ ํ•œ ์ค„ ํ†ต์ฐฐ (The Karpathy Summary) > "๋” ๋งŽ์ด ๋ถ“๋Š”๋‹ค๊ณ  ๋” ๋นจ๋ฆฌ ์ฐจ๋Š” ๊ฒƒ์€ ์•„๋‹ˆ๋‹ค." ํŠน์ • ์ƒ์‚ฐ ์š”์†Œ์˜ ํˆฌ์ž…์„ ๋Š˜๋ฆด ๋•Œ, ์ดˆ๊ธฐ์—๋Š” ์ƒ์‚ฐ๋Ÿ‰์ด ๊ธ‰์ฆํ•˜๋‹ค๊ฐ€ ์ผ์ • ์‹œ์ ์„ ๋„˜์–ด์„œ๋ฉด ํˆฌ์ž… ๋Œ€๋น„ ์–ป์–ด์ง€๋Š” ์„ฑ๊ณผ(ํ•œ๊ณ„ ์ƒ์‚ฐ๋Ÿ‰)๊ฐ€ ์ค„์–ด๋“œ๋Š” ๋ฒ•์น™์ด๋‹ค. ## ๐Ÿ“– ๊ตฌ์กฐํ™”๋œ ์ง€์‹ (Synthesized Content) - **The Curve**: - **Phase 1: Increasing Returns**: ํ˜‘๋™๊ณผ ํšจ์œจ์„ฑ ์ฆ๋Œ€๋กœ ์„ฑ๊ณผ๊ฐ€ ํญ๋ฐœํ•จ. - **Phase 2: Diminishing Returns**: ์ž์› ๊ฐ„์˜ ๋ณ‘๋ชฉ์ด ์ƒ๊ธฐ๋ฉฐ ํˆฌ์ž… ๋Œ€๋น„ ํšจ์œจ์ด ๋–จ์–ด์ง€๊ธฐ ์‹œ์ž‘ํ•จ. - **Phase 3: Negative Returns**: ๊ณผ๋„ํ•œ ํˆฌ์ž…์ด ์˜คํžˆ๋ ค ๊ด€๋ฆฌ ์˜ค๋ฒ„ํ—ค๋“œ๋‚˜ ์ž์› ๊ฐ„์„ญ์„ ์ผ์œผ์ผœ ์„ฑ๊ณผ๊ฐ€ ํ•˜๋ฝํ•จ. - **Examples**: - **Software Development**: ๊ฐœ๋ฐœ์ž ์ˆ˜๋ฅผ ๋Š˜๋ฆด์ˆ˜๋ก ์†Œํ†ต ๋น„์šฉ์ด ์ปค์ ธ ํ”„๋กœ์ ํŠธ๊ฐ€ ๋” ๋Šฆ์–ด์ง (๋ธŒ๋ฃฉ์Šค์˜ ๋ฒ•์น™). - **ML Training**: ๋ชจ๋ธ ํŒŒ๋ผ๋ฏธํ„ฐ๋ฅผ ๋ฌด์ž‘์ • ๋Š˜๋ ค๋„ ๋ฐ์ดํ„ฐ ํ’ˆ์งˆ์ด ๋‚ฎ์œผ๋ฉด ์„ฑ๋Šฅ ์„ฑ์žฅ์ด ๋ฉˆ์ถค. - **Strategic Insight**: '์ตœ์ ์˜ ํˆฌ์ž… ์ง€์ '์„ ์ฐพ์•„์•ผ ํ•˜๋ฉฐ, ๊ทธ ์ด์ƒ์˜ ๋…ธ๋ ฅ์€ '๋‚ญ๋น„'์ž„์„ ์ธ์ง€ํ•ด์•ผ ํ•œ๋‹ค. ## โš ๏ธ ๋ชจ์ˆœ ๋ฐ ์—…๋ฐ์ดํŠธ (RL Update) - AI ์Šค์ผ€์ผ๋ง ๋ฒ•์น™(Scaling Laws)์€ ํ•œ๊ณ„ ์ˆ˜์ต ์ฒด๊ฐ์„ ์ •๋ฉด์œผ๋กœ ๋ŒํŒŒํ•˜๋Š” ๊ฒƒ์ฒ˜๋Ÿผ ๋ณด์˜€๋‹ค. ํ•˜์ง€๋งŒ ์ตœ๊ทผ์—๋Š” ๋ชจ๋ธ ํฌ๊ธฐ๋ฅผ ํ‚ค์šฐ๋Š” ๊ฒƒ๋ณด๋‹ค ๋ฐ์ดํ„ฐ์˜ ์งˆ์„ ๋†’์ด๊ฑฐ๋‚˜ ์ถ”๋ก  ์‹œ๊ฐ„์„ ๋Š˜๋ฆฌ๋Š” ๊ฒƒ์ด ๋” ํšจ์œจ์ ์ž„์ด ๋ฐํ˜€์ง€๋ฉฐ, '์–ด๋–ค ์ž์›'์— ํˆฌ์žํ•  ๊ฒƒ์ธ๊ฐ€์— ๋Œ€ํ•œ ํŒจ๋Ÿฌ๋‹ค์ž„์ด ๋‹ค์‹œ ๋ณ€ํ•˜๊ณ  ์žˆ๋‹ค. ## ๐Ÿ”— ์ง€์‹ ์—ฐ๊ฒฐ (Graph) - Related: [[Amdahls Law (์•”๋‹ฌ์˜ ๋ฒ•์น™)]] , Scaling-Laws-of-Neural-[[Language-Models]] - Law: Brooks-Law