bluemsi/2nd
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

docs: finalized wiki integrity maintenance (v3.0 standard) - pruned 1400+ stubs and fixed 11k+ ghost links

Browse Source
This commit is contained in:
Antigravity Agent
2026-05-02 09:18:34 +09:00
parent c84dcb8371
commit 6445fcc05b
13150 changed files with 55394 additions and 100862 deletions
Download Patch File Download Diff File Expand all files Collapse all files
10_Wiki/Topics_Blog/Attention Mechanisms.md
+2 -2
View File
@@ -6,7 +6,7 @@ tags: [auto-reinforced, attention-mechanisms, transformer, deep-learning, neural
last_reinforced: 2026-04-20
---
# [[Attention Mechanisms]]
# [[Attention Mechanisms|Attention Mechanisms]]
## 📌 한 줄 통찰 (The Karpathy Summary)
> "지능의 조명등: 입력된 방대한 데이터 중 현재의 맥락에 가장 중요한 핵심 정보에만 가중치를 두어 '집중'함으로써, 복잡한 관계를 효율적으로 파악해내는 현대 AI 혁명의 핵심 동력."
@@ -29,6 +29,6 @@ last_reinforced: 2026-04-20
- **정책 변화(RL Update)**: 연산 비용 최적화 정책을 위해, 무거운 Full-attention 대신 연산량을 줄인 'Flash Attention'이나 'Linear Attention' 정책이 소형 모델 및 엣지 장치용 AI 정책의 핵심 기술로 채택됨.
## 🔗 지식 연결 (Graph)
- [[Transformers]], Deep Learning, Natural Language Processing (NLP), Information-Overload, Economics of Attention
- [[Transformers|Transformers]], Deep Learning, Natural Language Processing (NLP), Information-Overload, Economics of Attention
- **Modern Tech/Tools**: Multi-head Attention, FlashAttention, GPT, BERT.
---