--- id: CONTRAST-LEARN-001 category: Dev confidence_score: 1.0 tags: [ai, [[Deep-Learning|Deep-Learning]], [[Self-Supervised-Learning|Self-Supervised-Learning]], contrastive-learning, [[Representation-Learning|Representation-Learning]]] last_reinforced: 2026-04-26 --- # Contrastive Learning (λŒ€μ‘° ν•™μŠ΅) ## πŸ“Œ ν•œ 쀄 톡찰 (The Karpathy Summary) > "λΉ„μŠ·ν•œ 것은 κ°€κΉκ²Œ, λ‹€λ₯Έ 것은 λ©€κ²Œ λ°°μΉ˜ν•˜μ—¬ λ°μ΄ν„°μ˜ λ³Έμ§ˆμ„ νŒŒμ•…ν•˜λΌ" β€” λͺ…μ‹œμ μΈ 라벨 없이도 데이터 쌍 κ°„μ˜ μœ μ‚¬μ„±κ³Ό 차이성을 λΉ„κ΅ν•¨μœΌλ‘œμ¨ 의미 μžˆλŠ” νŠΉμ§•(Representation)을 슀슀둜 ν•™μŠ΅ν•˜λŠ” 자기 지도 ν•™μŠ΅ 기법. ## πŸ“– κ΅¬μ‘°ν™”λœ 지식 (Synthesized Content) - **μΆ”μΆœλœ νŒ¨ν„΄:** λ™μΌν•œ λ°μ΄ν„°μ˜ λ³€ν˜•(Augmentation)된 λͺ¨μŠ΅λ“€μ€ μ„œλ‘œ λ‹ΉκΈ°κ³ (Positive), μ„œλ‘œ λ‹€λ₯Έ 데이터듀은 λ°€μ–΄λ‚΄λŠ”(Negative) λ°©μ‹μœΌλ‘œ 잠재 곡간(Latent Space)을 μ •λ ¬ν•˜λŠ” μ΅œμ ν™” νŒ¨ν„΄. - **핡심 μš”μ†Œ:** - **Data Augmentation:** ν•˜λ‚˜μ˜ 이미지λ₯Ό νšŒμ „, 자λ₯΄κΈ°, 색상 λ³€μ‘° 등을 톡해 μ—¬λŸ¬ λ²„μ „μœΌλ‘œ λ§Œλ“¦. - **Encoder:** 데이터λ₯Ό 고차원 λ²‘ν„°λ‘œ λ³€ν™˜. - **Projection Head:** ν•™μŠ΅ νš¨μœ¨μ„ 높이기 μœ„ν•΄ 벑터λ₯Ό λ‹€μ‹œ μ••μΆ•. - **Contrastive Loss (예: InfoNCE):** 긍정 쌍의 κ±°λ¦¬λŠ” 쒁히고 λΆ€μ • 쌍의 κ±°λ¦¬λŠ” λ„“νžˆλŠ” 손싀 ν•¨μˆ˜. - **의의:** λŒ€κ·œλͺ¨ 라벨링 λΉ„μš© 없이도 κ³ μ„±λŠ₯ νŠΉμ§• μΆ”μΆœκΈ°λ₯Ό λ§Œλ“€ 수 μžˆμ–΄, [[CLIP|CLIP]]μ΄λ‚˜ SimCLR λ“± μ΅œμ‹  λͺ¨λΈλ“€μ˜ 핡심 기술둜 μ‚¬μš©λ¨. ## ⚠️ λͺ¨μˆœ 및 μ—…λ°μ΄νŠΈ (Contradictions & RL Update) - **κ³Όκ±° λ°μ΄ν„°μ™€μ˜ 좩돌:** μ •λ‹΅μ§€κ°€ λ°˜λ“œμ‹œ ν•„μš”ν–ˆλ˜ 지도 ν•™μŠ΅μ˜ ν•œκ³„λ₯Ό λ„˜μ–΄, μ›μ‹œ 데이터 자체의 κ΅¬μ‘°λ§ŒμœΌλ‘œλ„ μ§€λŠ₯을 ꡬ좕할 수 μžˆλŠ” 길을 μ—Ό. - **μ •μ±… λ³€ν™”:** Antigravity ν”„λ‘œμ νŠΈλŠ” μœ„ν‚€ λ¬Έμ„œ κ°„μ˜ 의미적 거리λ₯Ό κ³„μ‚°ν•˜κ±°λ‚˜ 쀑볡 λ¬Έμ„œλ₯Ό 탐지할 λ•Œ λŒ€μ‘° ν•™μŠ΅ 기반의 ν…μŠ€νŠΈ μž„λ² λ”© λͺ¨λΈμ„ 적극 ν™œμš©ν•¨. ## πŸ”— 지식 μ—°κ²° (Graph) - [[Representation-Learning|Representation-Learning]], [[Self-Supervised-Learning|Self-Supervised-Learning]], [[CLIP|CLIP]], Un[[Supervised-Learning-Foundations|Supervised-Learning-Foundations]] - **Raw Source:** 10_Wiki/Topics/AI/Contrastive-Learning.md