--- id: DL-RES-ARCH-001 category: "10_Wiki/πŸ’‘ Topics/AI" confidence_score: 1.0 tags: [ai, deep-learning, resnet, neural-architecture, computer-vision, bottleneck-layer, model-design] last_reinforced: 2026-04-26 --- # ResNet Architectures (ResNet μ•„ν‚€ν…μ²˜) ## πŸ“Œ ν•œ 쀄 톡찰 (The Karpathy Summary) > "μž‘μ€ 망(18, 34)은 μ •μ§ν•œ κ²°ν•©(Basic Block)으둜, κ±°λŒ€ν•œ 망(50, 101, 152)은 μ••μΆ•λœ κ²°ν•©(Bottleneck)으둜 μ„€κ³„ν•˜μ—¬ μ„±λŠ₯κ³Ό μ—°μ‚° 효율의 μ •κ΅ν•œ 밸런슀λ₯Ό λ‹¬μ„±ν•˜λΌ" β€” μž”μ°¨ ν•™μŠ΅ 원리λ₯Ό λ°”νƒ•μœΌλ‘œ 측의 κΉŠμ΄μ™€ λ³΅μž‘λ„λ₯Ό μ²΄κ³„μ μœΌλ‘œ μ„€κ³„ν•œ ResNet μ‹œλ¦¬μ¦ˆμ˜ ꡬ체적 λͺ…세와 λ³€ν˜• λͺ¨λΈλ“€. ## πŸ“– κ΅¬μ‘°ν™”λœ 지식 (Synthesized Content) - **μΆ”μΆœλœ νŒ¨ν„΄:** "Structural Scaling and Resource Optimization" β€” 얕은 μΈ΅μ—μ„œλŠ” μ—°μ‚° μ„±λŠ₯을 μœ„ν•΄ λ‹¨μˆœν•œ 2μΈ΅ ꡬ쑰λ₯Ό μ‚¬μš©ν•˜κ³ , κΉŠμ€ μΈ΅μ—μ„œλŠ” μ—°μ‚° λΉ„μš©μ„ 쀄이기 μœ„ν•΄ $1 \times 1$ μ»¨λ³Όλ£¨μ…˜μ„ ν™œμš©ν•œ 3μΈ΅ 보틀λ„₯ ꡬ쑰λ₯Ό μ±„νƒν•˜μ—¬ 전체 νŒŒλΌλ―Έν„° 수λ₯Ό κ΄€λ¦¬ν•˜λŠ” νŒ¨ν„΄. - **μ£Όμš” μ•„ν‚€ν…μ²˜ λͺ…μ„Έ:** - **ResNet-18 / 34:** Basic Block ($3 \times 3$ Conv μœ„μ£Ό) μ‚¬μš©. μ€‘μ†Œκ·œλͺ¨ 데이터셋에 적합. - **ResNet-50 / 101 / 152:** Bottleneck Block ($1 \times 1, 3 \times 3, 1 \times 1$ Conv) μ‚¬μš©. λŒ€κ·œλͺ¨ 데이터셋과 λ³΅μž‘ν•œ νŠΉμ§• μΆ”μΆœμ— 강점. - **Wide ResNet:** 깊이 λŒ€μ‹  λ„ˆλΉ„(Channel)λ₯Ό ν‚€μ›Œ μ„±λŠ₯ ν–₯상. - **ResNeXt:** κ·Έλ£Ή μ»¨λ³Όλ£¨μ…˜(Grouped Conv)을 λ„μž…ν•˜μ—¬ '기수(Cardinality)'λΌλŠ” μƒˆλ‘œμš΄ μ°¨μ›μ˜ ν™•μž₯ μ œμ‹œ. - **의의:** μ •ν˜•ν™”λœ μ•„ν‚€ν…μ²˜ 섀계 곡식을 μ œκ³΅ν•¨μœΌλ‘œμ¨ μ—°κ΅¬μžμ™€ μ—”μ§€λ‹ˆμ–΄λ“€μ΄ 각자의 ν•˜λ“œμ›¨μ–΄ μžμ›κ³Ό 문제 λ‚œμ΄λ„μ— λ§žλŠ” 졜적의 λͺ¨λΈμ„ μ†μ‰½κ²Œ 선택할 수 있게 함. ## ⚠️ λͺ¨μˆœ 및 μ—…λ°μ΄νŠΈ (Contradictions & RL Update) - **κ³Όκ±° λ°μ΄ν„°μ™€μ˜ 좩돌:** λ‹¨μˆœνžˆ λ ˆμ΄μ–΄λ₯Ό μŒ“κΈ°λ§Œ ν•˜λ©΄ μ„±λŠ₯이 μ’‹μ•„μ§„λ‹€λŠ” 초기 κΈ°λŒ€μ™€ 달리, 일정 깊이 μ΄μƒμ—μ„œλŠ” λͺ¨λΈμ˜ λ„ˆλΉ„λ‚˜ 기수λ₯Ό ν‚€μš°λŠ” 것이 ν•˜λ“œμ›¨μ–΄ 효율과 정확도 μΈ‘λ©΄μ—μ„œ 더 μœ λ¦¬ν•˜λ‹€λŠ” 사싀이 λ°ν˜€μ§€λ©° λͺ¨λΈ 섀계 νŠΈλ Œλ“œκ°€ 변화함. - **μ •μ±… λ³€ν™”:** Antigravity ν”„λ‘œμ νŠΈλŠ” λΉ„μ „ μ„œλΉ„μŠ€μ˜ μš”κ΅¬ μ„±λŠ₯에 따라 μ—£μ§€ 기기용(ResNet-18)λΆ€ν„° κ³ μ„±λŠ₯ μ„œλ²„μš©(ResNet-101/152)κΉŒμ§€ μ΅œμ ν™”λœ μ•„ν‚€ν…μ²˜ 프리셋을 μ œκ³΅ν•¨. ## πŸ”— 지식 μ—°κ²° (Graph) - [[Residual-Networks|Residual-Networks]], Deep-Learning-Foundations, Convolutional-Neural-Networks-CNN, Model-Compression-and-Deployment - **Raw Source:** 10_Wiki/Topics/AI/ResNet-Architectures.md