--- id: ANNEAL-001 category: "[[10_Wiki/๐Ÿ’ก Topics/AI]]" confidence_score: 1.0 tags: [optimization, algorithm, heuristics, statistical-mechanics] last_reinforced: 2026-04-26 --- # [[Simulated Annealing (์‹œ๋ฎฌ๋ ˆ์ด์…˜ ์–ด๋‹๋ง)]] ## ๐Ÿ“Œ ํ•œ ์ค„ ํ†ต์ฐฐ (The Karpathy Summary) > "์ง€์—ญ ์ตœ์ ํ•ด์—์„œ ๋ฒ—์–ด๋‚˜๊ธฐ ์œ„ํ•ด ๋•Œ๋กœ๋Š” '๋ชจํ—˜'์„ ํ—ˆ์šฉํ•˜๋ผ" โ€” ๊ธˆ์†์„ ๋œจ๊ฒ๊ฒŒ ๋‹ฌ๊ตฌ์—ˆ๋‹ค๊ฐ€ ์ฒœ์ฒœํžˆ ์‹ํžˆ๋ฉฐ ๊ฒฐ์ • ๊ตฌ์กฐ๋ฅผ ์•ˆ์ •ํ™”์‹œํ‚ค๋Š” ๋‹ด๊ธˆ์งˆ(Annealing) ๊ณผ์ •์„ ๋ชจ๋ฐฉํ•˜์—ฌ, ํ™•๋ฅ ์ ์œผ๋กœ ๋” ๋‚˜์œ ํ•ด๋ฅผ ์ˆ˜์šฉํ•จ์œผ๋กœ์จ ์ „์—ญ ์ตœ์ ํ•ด๋ฅผ ์ฐพ์•„๊ฐ€๋Š” ํ™•๋ฅ ์  ํƒ์ƒ‰ ์•Œ๊ณ ๋ฆฌ์ฆ˜. ## ๐Ÿ“– ๊ตฌ์กฐํ™”๋œ ์ง€์‹ (Synthesized Content) - **์ถ”์ถœ๋œ ํŒจํ„ด:** ์ดˆ๊ธฐ์—๋Š” ๋†’์€ '์˜จ๋„(Probability)'๋ฅผ ์œ ์ง€ํ•˜์—ฌ ํƒ์ƒ‰ ๊ณต๊ฐ„์„ ๋„“๊ฒŒ ํ›‘๊ณ , ์‹œ๊ฐ„์ด ์ง€๋‚จ์— ๋”ฐ๋ผ ์˜จ๋„๋ฅผ ๋‚ฎ์ถ”๋ฉฐ ํ˜„์žฌ ์œ„์น˜ ๊ทผ์ฒ˜์—์„œ ์ •๊ตํ•˜๊ฒŒ ์ˆ˜๋ ดํ•˜๋Š” ์ „์—ญ ์ตœ์ ํ™” ํŒจํ„ด. - **์„ธ๋ถ€ ๋‚ด์šฉ:** - **Metropolis Criterion:** ํ˜„์žฌ๋ณด๋‹ค ์ข‹์ง€ ์•Š์€ ํ•ด๋ผ๋„ ํŠน์ • ํ™•๋ฅ ($e^{-\Delta E / T}$)๋กœ ์ˆ˜์šฉํ•˜์—ฌ ์ง€์—ญ ์ตœ์ ํ•ด(Local Optima) ํƒˆ์ถœ ์œ ๋„. - **Cooling Schedule:** ์˜จ๋„๋ฅผ ๋‚ฎ์ถ”๋Š” ์†๋„์™€ ๋ฐฉ์‹ ์ •์˜. ๋„ˆ๋ฌด ๋น ๋ฅด๋ฉด ์ง€์—ญ ์ตœ์ ํ•ด์— ๊ฐ‡ํžˆ๊ณ , ๋„ˆ๋ฌด ๋А๋ฆฌ๋ฉด ์—ฐ์‚ฐ ๋น„์šฉ ๊ณผ๋‹ค ๋ฐœ์ƒ. - **Combinatorial Optimization:** ์™ธํŒ์› ๋ฌธ์ œ(TSP)๋‚˜ ํšŒ๋กœ ์„ค๊ณ„ ๋“ฑ ํƒ์ƒ‰ ๊ณต๊ฐ„์ด ๋ฐฉ๋Œ€ํ•˜๊ณ  ๋ถˆ์—ฐ์†์ ์ธ ๋ฌธ์ œ์—์„œ ๊ฐ•๋ ฅํ•œ ์„ฑ๋Šฅ ๋ฐœํœ˜. ## โš ๏ธ ๋ชจ์ˆœ ๋ฐ ์—…๋ฐ์ดํŠธ (Contradictions & RL Update) - **๊ณผ๊ฑฐ ๋ฐ์ดํ„ฐ์™€์˜ ์ถฉ๋Œ:** ๋ฏธ๋ถ„์ด ๊ฐ€๋Šฅํ•œ ๊ณต๊ฐ„์—์„œ์˜ ๊ฒฝ์‚ฌ ํ•˜๊ฐ•๋ฒ•์— ๋น„ํ•ด ์†๋„๋Š” ๋А๋ฆฌ์ง€๋งŒ, ๋ฏธ๋ถ„์ด ๋ถˆ๊ฐ€๋Šฅํ•˜๊ฑฐ๋‚˜ ๋งค์šฐ ๋ถˆ๊ทœ์น™ํ•œ ์—๋„ˆ์ง€ ์ง€ํ˜•์„ ๊ฐ€์ง„ ๋ฌธ์ œ์—์„œ ์—ฌ์ „ํžˆ ๋…๋ณด์ ์ธ ์œ ์—ฐ์„ฑ์„ ๊ฐ€์ง. - **์ •์ฑ… ๋ณ€ํ™”:** Antigravity ํ”„๋กœ์ ํŠธ์˜ ์ž์› ํ• ๋‹น ์ตœ์ ํ™” ๋ฐ ๋ณต์žกํ•œ ์›Œํฌํ”Œ๋กœ์šฐ ์Šค์ผ€์ค„๋ง ์‹œ, ์‹œ๋ฎฌ๋ ˆ์ด์…˜ ์–ด๋‹๋ง ์•Œ๊ณ ๋ฆฌ์ฆ˜์„ ์‚ฌ์šฉํ•˜์—ฌ ์ตœ์ ์˜ ๋ฐฐ์น˜ ์กฐํ•ฉ์„ ์‚ฐ์ถœํ•จ. ## ๐Ÿ”— ์ง€์‹ ์—ฐ๊ฒฐ (Graph) - [[Optimization]], [[Genetic-Algorithms]], [[Stochastic-Gradient-Descent]], [[Statistical-Mechanics]] - **Raw Source:** [[10_Wiki/Topics/AI/Simulated-Annealing.md]]