bluemsi/2nd
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

feat: complete wikification of War Commander batch 1&2 and final grey dot cleanup

Browse Source
This commit is contained in:
yesung
2026-04-27 18:58:22 +09:00
parent 3424166ea2
commit 6b86b0da4c
2706 changed files with 9074 additions and 7273 deletions
Download Patch File Download Diff File Expand all files Collapse all files
10_Wiki/Topics/AI/Information-Theory.md
+4 -4
View File
@@ -1,12 +1,12 @@
---
id: INFO-THEORY-001
category: "[[10_Wiki/💡 Topics/AI]]"
category: "10_Wiki/💡 Topics/AI"
confidence_score: 1.0
tags: [math, communication, entropy, data-compression, ai-foundations]
last_reinforced: 2026-04-26
---
# [[Information Theory (정보 이론)]]
# Information Theory (정보 이론)
## 📌 한 줄 통찰 (The Karpathy Summary)
> "불확실성을 측정하고 통신을 수치화하라" — 클로드 섀넌이 정립한, 정보의 양을 엔트로피(Entropy)라는 개념으로 정의하고 데이터 압축 및 전송의 한계를 규명한 수학적 기초.
@@ -24,5 +24,5 @@ last_reinforced: 2026-04-26
- **정책 변화:** Antigravity 에이전트의 응답 생성 시, '정보 밀도'를 높이기 위해 불필요한 반복을 제거하고 핵심 엔트로피가 높은 텍스트를 구성하도록 유도함.
## 🔗 지식 연결 (Graph)
- [[Entropy]], [[Cross-Entropy]], [[Data-Compression]], [[Machine-Learning]]
- **Raw Source:** [[10_Wiki/Topics/AI/Information-Theory.md]]
- Entropy, Cross-Entropy, Data-Compression, Machine-Learning
- **Raw Source:** 10_Wiki/Topics/AI/Information-Theory.md