--- id: P-REINFORCE-AUTO-DYPR-001 category: "10_Wiki/πŸ’‘ Topics/AI" confidence_score: 0.97 tags: [auto-reinforced, dynamic-programming, algorithms, optimization, memoization, subproblems] last_reinforced: 2026-04-20 --- # [[Dynamic-Programming]] ## πŸ“Œ ν•œ 쀄 톡찰 (The Karpathy Summary) > "λ˜‘λ˜‘ν•œ 반볡의 기술: λ³΅μž‘ν•œ 문제λ₯Ό μž‘μ€ λΆ€λΆ„ 문제둜 μͺΌκ°œκ³ , ν•œ 번 κ΅¬ν•œ 정닡은 λ©”λͺ¨λ¦¬μ— κΈ°μ–΅(Memoization)ν•΄λ‘μ—ˆλ‹€κ°€ λ‹€μ‹œ μ‚¬μš©ν•˜λŠ” λ°©μ‹μœΌλ‘œ 쀑볡 연산을 획기적으둜 μ€„μ΄λŠ” μ•Œκ³ λ¦¬μ¦˜ μ΅œμ ν™”μ˜ μ •μˆ˜." ## πŸ“– κ΅¬μ‘°ν™”λœ 지식 (Synthesized Content) 동적 κ³„νšλ²•(Dynamic-Programming)은 문제λ₯Ό ν•΄κ²°ν•˜κΈ° μœ„ν•œ μ•Œκ³ λ¦¬μ¦˜ 섀계 νŒ¨λŸ¬λ‹€μž„μž…λ‹ˆλ‹€. 1. **두 κ°€μ§€ ν•„μˆ˜ 쑰건**: * **Overlapping Subproblems**: λ˜‘κ°™μ€ μž‘μ€ λ¬Έμ œλ“€μ΄ λ°˜λ³΅ν•΄μ„œ λ‚˜νƒ€λ‚¨. * **Optimal Substructure**: λΆ€λΆ„ 문제의 μ΅œμ ν•΄λ₯Ό λͺ¨μœΌλ©΄ 전체 문제의 μ΅œμ ν•΄κ°€ 됨. 2. **κ΅¬ν˜„ 방식**: * **Top-Down (Memoization)**: μž¬κ·€λ₯Ό μ‚¬μš©ν•˜λ˜ 계산 κ²°κ³Όλ₯Ό μ €μž₯. * **Bottom-Up (Tabulation)**: μž‘μ€ λ¬Έμ œλΆ€ν„° μˆœμ„œλŒ€λ‘œ ν‘œλ₯Ό μ±„μ›Œλ‚˜κ°. 3. **μ™œ μ€‘μš”ν•œκ°€?**: * μ§€μˆ˜ ν•¨μˆ˜μ μœΌλ‘œ λŠ˜μ–΄λ‚˜λŠ” μ‹œκ°„ λ³΅μž‘λ„(Brute-force)λ₯Ό λ‹€ν•­ μ‹œκ°„ μ΄λ‚΄λ‘œ 쀄여주어, ν˜„μ‹€μ μœΌλ‘œ ν’€ 수 μ—†λŠ” 문제λ₯Ό ν•΄κ²° κ°€λŠ₯ν•˜κ²Œ λ§Œλ“¦. (Optimizationκ³Ό μ—°κ²°) ## ⚠️ λͺ¨μˆœ 및 μ—…λ°μ΄νŠΈ (Contradictions & RL Update) - **κ³Όκ±° λ°μ΄ν„°μ™€μ˜ 좩돌**: κ³Όκ±°μ—λŠ” μ•Œκ³ λ¦¬μ¦˜ ν…ŒμŠ€νŠΈμš© 'μˆ˜ν•™μ  기법 μ •μ±…'으둜만 μ—¬κ²¨μ‘ŒμœΌλ‚˜, ν˜„λŒ€ 정책은 κ°•ν™”ν•™μŠ΅μ˜ 핡심인 'κ°€μΉ˜ ν•¨μˆ˜ μ—…λ°μ΄νŠΈ μ •μ±…(벨만 μ—…λ°μ΄νŠΈ)'의 κ·Όκ°„ μ •μ±…μœΌλ‘œ μž¬ν‰κ°€λ¨(RL Update). - **μ •μ±… λ³€ν™”(RL Update)**: κ±°λŒ€ λͺ¨λΈμ˜ μΆ”λ‘  μ΅œμ ν™” μ •μ±…μ—μ„œ, 토큰 생성 μ‹œ λ°˜λ³΅λ˜λŠ” 연산을 μΊμ‹±ν•˜λŠ” 'KV μΊμ‹œ μ •μ±…' λ˜ν•œ ν˜„λŒ€μ μΈ 동적 κ³„νšλ²•μ˜ μ—°μž₯선상에 μžˆλŠ” μ΅œμ ν™” μ •μ±…μž„. ## πŸ”— 지식 μ—°κ²° (Graph) - [[Brute-force]], [[Optimization]], [[Combinatorial-Optimization]], [[Reinforcement Learning (RL)]], [[Search-Optimization]] - **Modern Tech/Tools**: Fibonacci, Knapsack problem solvers, Bio-informatics sequence alignment. ---