bluemsi/2nd
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

docs: finalized wiki integrity maintenance (v3.0 standard) - pruned 1400+ stubs and fixed 11k+ ghost links

Browse Source
This commit is contained in:
Antigravity Agent
2026-05-02 09:18:34 +09:00
parent c84dcb8371
commit 6445fcc05b
13150 changed files with 55394 additions and 100862 deletions
Download Patch File Download Diff File Expand all files Collapse all files
01_Archive/2026-04-20/Information Theory.md
+5 -5
View File
@@ -1,13 +1,13 @@
---
id: P-REINFORCE-AI-052
category: "[[10_Wiki/💡 Topics/Computational Theory & Math]]"
category: "10_Wiki/💡 Topics/Computational Theory & Math"
confidence_score: 0.98
tags: [information theory, shannon entropy, compression, information]
last_reinforced: 2026-06-XX
github_commit: "[P-Reinforce] Processed Information Theory."
---
# [[Information Theory]] (정보 이론)
# [[Information Theory|Information Theory]] (정보 이론)
## 📌 한 줄 통찰 (The Karpathy Summary)
> 정보의 양과 질을 수학적으로 측정하는 학문으로, 불확실성을 감소시키는 정도를 '엔트로피'로 정의하여 데이터 압축, AI 모델의 효율성, 그리고 지식의 전달 과정을 정량화한다.
@@ -26,7 +26,7 @@ github_commit: "[P-Reinforce] Processed Information Theory."
- **정책 변화:** 최근에는 LLM의 성능 평가에 단순히 Perplexity 같은 전통적인 엔트로피 개념뿐만 아니라, '일관성 (Coherence)'과 '사실 정확도'를 결합한 새로운 측정 지표가 요구되고 있다.
## 🔗 지식 연결 (Graph)
- Parent: [[Computational Thinking]]
- Related: [[Shannon Entropy]] , [[Information-Architecture]] , [[AI 모델 평가]]
- Raw Source: [[00_Raw/Information Theory.md]]
- Parent: [[Computational Thinking|Computational Thinking]]
- Related: [[Shannon-Entropy|Shannon Entropy]] , [[Information-Architecture|Information-Architecture]] , AI 모델 평가
- Raw Source: 00_Raw/Information Theory.md
---