--- id: BIG-O-001 category: "10_Wiki/πŸ’‘ Topics/AI" confidence_score: 1.0 tags: [computer-science, algorithm, complexity, optimization, big-o] last_reinforced: 2026-04-26 --- # Algorithm Complexity (Big O, μ•Œκ³ λ¦¬μ¦˜ λ³΅μž‘λ„) ## πŸ“Œ ν•œ 쀄 톡찰 (The Karpathy Summary) > "데이터가 λ¬΄ν•œνžˆ λŠ˜μ–΄λ‚  λ•Œ, μ•Œκ³ λ¦¬μ¦˜μ΄ μ–Όλ§ˆλ‚˜ 버틸 수 μžˆλŠ”μ§€ μΈ‘μ •ν•˜λΌ" β€” μž…λ ₯ λ°μ΄ν„°μ˜ 크기($n$)에 λ”°λ₯Έ μ‹œκ°„μ (Time) 및 곡간적(Space) μžμ› μ†Œλͺ¨λŸ‰μ˜ 증가 μΆ”μ„Έλ₯Ό λ‚˜νƒ€λ‚΄λŠ” μˆ˜ν•™μ  ν‘œκΈ°λ²•. ## πŸ“– κ΅¬μ‘°ν™”λœ 지식 (Synthesized Content) - **μΆ”μΆœλœ νŒ¨ν„΄:** ꡬ체적인 μ‹€ν–‰ μ‹œκ°„ λŒ€μ‹  μ΅œμ•…μ˜ 경우(Worst-case)λ₯Ό κΈ°μ€€μœΌλ‘œ μ•Œκ³ λ¦¬μ¦˜μ˜ ν™•μž₯μ„±(Scalability)을 λΆ„λ₯˜ν•˜μ—¬ 효율적인 섀계λ₯Ό λ•λŠ” 좔상화 νŒ¨ν„΄. - **μ£Όμš” λ³΅μž‘λ„ 단계:** - **$O(1)$:** μƒμˆ˜ μ‹œκ°„. μž…λ ₯ 크기와 λ¬΄κ΄€ν•˜κ²Œ μ¦‰μ‹œ 처리 (예: λ°°μ—΄ 인덱슀 μ ‘κ·Ό). - **$O(\log n)$:** 둜그 μ‹œκ°„. 처리 λ²”μœ„κ°€ μ ˆλ°˜μ”© 쀄어듦 (예: 이진 탐색). - **$O(n)$:** μ„ ν˜• μ‹œκ°„. μž…λ ₯ 크기에 λΉ„λ‘€ (예: λ‹¨μˆœ 반볡문). - **$O(n \log n)$:** μ„ ν˜• 둜그 μ‹œκ°„. 효율적인 μ •λ ¬ μ•Œκ³ λ¦¬μ¦˜ (예: Merge Sort, Quick Sort). - **$O(n^2)$:** 이차 μ‹œκ°„. 이쀑 반볡문. λŒ€κ·œλͺ¨ λ°μ΄ν„°μ—μ„œ κΈ°ν•˜κΈ‰μˆ˜μ μœΌλ‘œ 느렀짐. - **$O(2^n)$:** μ§€μˆ˜ μ‹œκ°„. 맀우 μœ„ν—˜ν•œ λ³΅μž‘λ„ (예: ν”Όλ³΄λ‚˜μΉ˜ μž¬κ·€). - **의의:** AI λͺ¨λΈ ν•™μŠ΅μ΄λ‚˜ λŒ€κ·œλͺ¨ 인덱싱 μ‹œ μ•Œκ³ λ¦¬μ¦˜ μ„ νƒμ˜ 결정적 기쀀이 됨. ## ⚠️ λͺ¨μˆœ 및 μ—…λ°μ΄νŠΈ (Contradictions & RL Update) - **κ³Όκ±° λ°μ΄ν„°μ™€μ˜ 좩돌:** λ‹¨μˆœνžˆ 'λΉ λ₯Έ' μ•Œκ³ λ¦¬μ¦˜μ„ 찾던 μ‹œκΈ°μ—μ„œ, λ©”λͺ¨λ¦¬ μ‚¬μš©λŸ‰(Space Complexity)κ³Ό μΊμ‹œ νš¨μœ¨μ„±κΉŒμ§€ κ³ λ €ν•˜λŠ” 닀각적 μ΅œμ ν™” μ‹œλŒ€λ‘œ μ§„ν™”. - **μ •μ±… λ³€ν™”:** Antigravity ν”„λ‘œμ νŠΈλŠ” λͺ¨λ“  지식 검색 및 ν΄λŸ¬μŠ€ν„°λ§ μ•Œκ³ λ¦¬μ¦˜ λ„μž… μ‹œ μ΅œμ•…μ˜ 경우 $O(n \log n)$ μ΄ν•˜μ˜ λ³΅μž‘λ„λ₯Ό μœ μ§€ν•˜λŠ” 것을 μ›μΉ™μœΌλ‘œ 함. ## πŸ”— 지식 μ—°κ²° (Graph) - Algorithm, [[Parallel-Computing|Parallel-Computing]], Vector-Database-Selection, [[Optimization|Optimization]] - **Raw Source:** 10_Wiki/Topics/AI/Algorithm-Complexity-Big-O.md