--- id: P-REINFORCE-AUTO-PPCA-001 category: "10_Wiki/๐Ÿ’ก Topics/AI" confidence_score: 0.98 tags: [auto-reinforced, pca, dimension-reduction, data-analysis, machine-learning, statistics] last_reinforced: 2026-04-20 --- # [[Principle-Component-Analysis]] ## ๐Ÿ“Œ ํ•œ ์ค„ ํ†ต์ฐฐ (The Karpathy Summary) > "๋ฐ์ดํ„ฐ์˜ ์—‘์Šค๋ ˆ์ด: ์ˆ˜๋ฐฑ ๊ฐœ์˜ ๋ณต์žกํ•œ ๋ณ€์ˆ˜ ์ค‘์—์„œ ๋ฐ์ดํ„ฐ์˜ ๋ณธ์งˆ์  ๋ณ€๋™(Variance)์„ ๊ฐ€์žฅ ์ž˜ ์„ค๋ช…ํ•˜๋Š” ํ•ต์‹ฌ ์ถ•(์ฃผ์„ฑ๋ถ„) ๋ช‡ ๊ฐœ๋งŒ ์ถ”๋ ค๋‚ด์–ด, ์ •๋ณด์˜ ํ•ต์‹ฌ์€ ์‚ด๋ฆฌ๊ณ  ๋…ธ์ด์ฆˆ์™€ ๊ตฐ๋”๋”๊ธฐ๋Š” ๊ฑท์–ด๋‚ด๋Š” ๊ณ ์ฐจ์›์˜ ์‹œ๊ฐํ™” ๋งˆ๋ฒ•." ## ๐Ÿ“– ๊ตฌ์กฐํ™”๋œ ์ง€์‹ (Synthesized Content) ์ฃผ์„ฑ๋ถ„ ๋ถ„์„(PCA)์€ ๊ณ ์ฐจ์›์˜ ๋ฐ์ดํ„ฐ๋ฅผ ์ €์ฐจ์›์œผ๋กœ ์ถ•์†Œํ•˜๋ฉด์„œ ์ •๋ณด ์†์‹ค์„ ์ตœ์†Œํ™”ํ•˜๋Š” ํ†ต๊ณ„์  ๊ธฐ๋ฒ•์ž…๋‹ˆ๋‹ค. 1. **์ž‘๋™ ์›์น™**: * ๋ฐ์ดํ„ฐ๊ฐ€ ๊ฐ€์žฅ ๋„๋ฆฌ ํผ์ ธ ์žˆ๋Š”(๋ถ„์‚ฐ์ด ํฐ) ๋ฐฉํ–ฅ์„ ์ฒซ ๋ฒˆ์งธ ์ฃผ์„ฑ๋ถ„($PC_1$)์œผ๋กœ ์„ค์ •. * ๊ทธ ๋ฐฉํ–ฅ๊ณผ ์ˆ˜์ง์ด๋ฉด์„œ ๊ทธ๋‹ค์Œ ๋ถ„์‚ฐ์ด ํฐ ๊ณณ์„ $PC_2$๋กœ ์„ค์ •. (Linear-Algebra์™€ ์—ฐ๊ฒฐ) 2. **ํšจ๊ณผ**: * **Dimension Reduction**: ์—ฐ์‚ฐ๋Ÿ‰ ํญ๊ฐ. (Efficiency์™€ ์—ฐ๊ฒฐ) * **Visualization**: ์ˆ˜๋ฐฑ ์ฐจ์›์˜ ๋ฐ์ดํ„ฐ๋ฅผ 2~3์ฐจ์›์œผ๋กœ ๊ทธ๋ ค ํ•œ๋ˆˆ์— ํŒŒ์•…. * **Noise Filtering**: ๋ถ„์‚ฐ์ด ์ž‘์€ ํ•˜์œ„ ์ฃผ์„ฑ๋ถ„(์žก์Œ) ์ œ๊ฑฐ. (Noise์™€ ์—ฐ๊ฒฐ) ## โš ๏ธ ๋ชจ์ˆœ ๋ฐ ์—…๋ฐ์ดํŠธ (Contradictions & RL Update) - **๊ณผ๊ฑฐ ๋ฐ์ดํ„ฐ์™€์˜ ์ถฉ๋Œ**: ๊ณผ๊ฑฐ์—๋Š” ์„ ํ˜•์ ์ธ ๊ด€๊ณ„๋งŒ ๋ถ„์„ํ•˜๋Š” ์ •์ฑ…(Linear PCA)์ด์—ˆ์œผ๋‚˜, ํ˜„๋Œ€ ์ •์ฑ…์€ ๋ณต์žกํ•˜๊ฒŒ ์–ฝํžŒ ๋ฐ์ดํ„ฐ์˜ ๊ณก๋ฉด๊นŒ์ง€ ํŒŒ์•…ํ•˜๋Š” '์ปค๋„ PCA ์ •์ฑ…'์ด๋‚˜ '์˜คํ† ์ธ์ฝ”๋”(Autoencoder) ์ •์ฑ…'์œผ๋กœ ๊ทธ ๊ฐœ๋…์ด ํ™•์žฅ๋จ(RL Update). - **์ •์ฑ… ๋ณ€ํ™”(RL Update)**: ๋‹จ์ˆœํžˆ ๋ฐ์ดํ„ฐ๋ฅผ ์ค„์ด๋Š” ์ •์ฑ…์„ ๋„˜์–ด, LLM ๋‚ด๋ถ€์˜ ๊ฑฐ๋Œ€ํ•œ ์ž„๋ฒ ๋”ฉ ๊ณต๊ฐ„ ์ •์ฑ…์ด ์–ด๋–ค ๊ตฌ์กฐ๋ฅผ ๊ฐ€์ง€๊ณ  ์žˆ๋Š”์ง€ ๋ถ„์„ํ•˜์—ฌ AI์˜ '์‚ฌ๊ณ  ์ฒด๊ณ„'๋ฅผ ์—ฟ๋ณด๋Š” ํ•ด์„ ๋„๊ตฌ ์ •์ฑ…์œผ๋กœ๋„ ๋„๋ฆฌ ํ™œ์šฉ ์ค‘์ž„. (Explainable-AI (XAI)์™€ ์—ฐ๊ฒฐ) ## ๐Ÿ”— ์ง€์‹ ์—ฐ๊ฒฐ (Graph) - [[Linear-Algebra]], [[Noise]], [[Efficiency]], [[Explainable-AI (XAI)]], [[Optimization]] - **Modern Tech/Tools**: Eigen-decomposition, SVD (Singular Value Decomposition), Scikit-learn (PCA). ---