bluemsi/2nd
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

[G1-Sync] Manual knowledge update

Browse Source
This commit is contained in:
Antigravity Agent
2026-04-30 22:42:02 +09:00
parent 0bd4f19e38
commit c36c0644a1
4888 changed files with 18470 additions and 18602 deletions
Download Patch File Download Diff File Expand all files Collapse all files
10_Wiki/Topics/Attention Mechanisms.md
+4 -4
View File
@@ -1,8 +1,8 @@
---
id: P-REINFORCE-AUTO-ATME-001
id: [[P-Reinforce]]-AUTO-ATME-001
category: "10_Wiki/💡 Topics/AI"
confidence_score: 1.00
tags: [auto-reinforced, attention-mechanisms, transformer, deep-learning, neural-networks, ai-architecture]
tags: [auto-reinforced, attention-mechanisms, transformer, [[Deep-Learning]], neural-networks, ai-[[Architecture]]]
last_reinforced: 2026-04-20
---
@@ -29,6 +29,6 @@ last_reinforced: 2026-04-20
- **정책 변화(RL Update)**: 연산 비용 최적화 정책을 위해, 무거운 Full-attention 대신 연산량을 줄인 'Flash Attention'이나 'Linear Attention' 정책이 소형 모델 및 엣지 장치용 AI 정책의 핵심 기술로 채택됨.
## 🔗 지식 연결 (Graph)
- [[Transformers]], Deep Learning, Natural Language Processing (NLP), Information-Overload, Economics of Attention
- **Modern Tech/Tools**: Multi-head Attention, FlashAttention, GPT, BERT.
- [[Transformers]], Deep Learning, Natural Language [[Processing]] (NLP), Information-Overload, Economics of Attention
- **Modern Tech/Tools**: Multi-head Attention, FlashAttention, GPT, [[BERT]].
---