--- id: ALGO-NNS-001 category: "10_Wiki/๐Ÿ’ก Topics/AI" confidence_score: 1.0 tags: [algorithm, ai, search, nearest-neighbor, ann, vector-database, similarity-search] last_reinforced: 2026-04-26 --- # Nearest Neighbor Search (์ตœ๊ทผ์ ‘ ์ด์›ƒ ํƒ์ƒ‰) ## ๐Ÿ“Œ ํ•œ ์ค„ ํ†ต์ฐฐ (The Karpathy Summary) > "๊ณ ์ฐจ์› ๊ณต๊ฐ„์˜ ๋ฐ”๋‹ค์—์„œ ๋‚˜๋ฅผ ๊ฐ€์žฅ ๋‹ฎ์€ ์ด์›ƒ์„ ๋ˆˆ๊นœ์งํ•  ์ƒˆ์— ๋ฐœ๊ตดํ•˜์—ฌ, ๋ฐ์ดํ„ฐ ์‚ฌ์ด์˜ ๋ณด์ด์ง€ ์•Š๋Š” ์—ฐ๊ฒฐ๊ณ ๋ฆฌ๋ฅผ ์ฆ๋ช…ํ•˜๋ผ" โ€” ์ฃผ์–ด์ง„ ์งˆ์˜(Query)์™€ ๊ฐ€์žฅ ์œ ์‚ฌํ•œ ๋ฐ์ดํ„ฐ๋ฅผ ๋ฐฉ๋Œ€ํ•œ ๋ฐ์ดํ„ฐ์…‹ ๋‚ด์—์„œ ๊ฑฐ๋ฆฌ ๋ฉ”ํŠธ๋ฆญ(Euclidean, Cosine ๋“ฑ)์„ ๊ธฐ๋ฐ˜์œผ๋กœ ์ฐพ์•„๋‚ด๋Š” ๊ฒ€์ƒ‰ ๊ธฐ์ˆ . ## ๐Ÿ“– ๊ตฌ์กฐํ™”๋œ ์ง€์‹ (Synthesized Content) - **์ถ”์ถœ๋œ ํŒจํ„ด:** "Space Partitioning and Approximate Retrieval" โ€” ์ „์ˆ˜ ์กฐ์‚ฌ(Brute-force)์˜ ๋น„ํšจ์œจ์„ฑ์„ ๊ทน๋ณตํ•˜๊ธฐ ์œ„ํ•ด ๊ณต๊ฐ„์„ ๋‹ค๊ฐํ˜•์ด๋‚˜ ํŠธ๋ฆฌ ๊ตฌ์กฐ๋กœ ๋ถ„ํ• ํ•˜๊ณ , 100%์˜ ์ •ํ™•๋„ ๋Œ€์‹  ์••๋„์ ์ธ ์†๋„๋ฅผ ์„ ํƒํ•˜๋Š” ๊ทผ์‚ฌ ์ตœ๊ทผ์ ‘ ์ด์›ƒ(ANN) ๊ฒ€์ƒ‰ ํŒจํ„ด. - **์ฃผ์š” ์•Œ๊ณ ๋ฆฌ์ฆ˜:** - **KD-Tree / Ball-Tree:** ๊ณต๊ฐ„์„ ๋ถ„ํ• ํ•˜์—ฌ ํƒ์ƒ‰ ๋ฒ”์œ„๋ฅผ ์ขํžˆ๋Š” ํŠธ๋ฆฌ ๊ธฐ๋ฐ˜ ๋ฐฉ์‹. - **HNSW (Hierarchical Navigable Small World):** ๊ทธ๋ž˜ํ”„ ๊ตฌ์กฐ๋ฅผ ํ™œ์šฉํ•œ ๊ณ ์„ฑ๋Šฅ ๊ฒ€์ƒ‰์˜ ํ˜„๋Œ€์  ํ‘œ์ค€. - **Product Quantization (PQ):** ๋ฒกํ„ฐ๋ฅผ ์••์ถ•ํ•˜์—ฌ ๋ฉ”๋ชจ๋ฆฌ ํšจ์œจ๊ณผ ๊ฒ€์ƒ‰ ์†๋„ ๋™์‹œ ํ™•๋ณด. - **์˜์˜:** ์ถ”์ฒœ ์‹œ์Šคํ…œ, ์ด๋ฏธ์ง€ ๊ฒ€์ƒ‰, ํŠนํžˆ LLM์˜ ์™ธ๋ถ€ ๊ธฐ์–ต ์žฅ์น˜ ์—ญํ• ์„ ํ•˜๋Š” ๋ฒกํ„ฐ ๋ฐ์ดํ„ฐ๋ฒ ์ด์Šค(Vector DB)์˜ ์„ฑ๋Šฅ์„ ๊ฒฐ์ •์ง“๋Š” ํ•ต์‹ฌ ์—”์ง„. ## โš ๏ธ ๋ชจ์ˆœ ๋ฐ ์—…๋ฐ์ดํŠธ (Contradictions & RL Update) - **๊ณผ๊ฑฐ ๋ฐ์ดํ„ฐ์™€์˜ ์ถฉ๋Œ:** ๋‹จ์ˆœํžˆ '๊ฐ€์žฅ ๊ฐ€๊นŒ์šด ๊ฒƒ'์„ ์ฐพ๋Š” ์ •์  ๊ฒ€์ƒ‰์—์„œ, ์ด์ œ๋Š” ์‹ค์‹œ๊ฐ„์œผ๋กœ ๋ฐ์ดํ„ฐ๊ฐ€ ์ถ”๊ฐ€/์‚ญ์ œ๋˜๋Š” ํ™˜๊ฒฝ์—์„œ๋„ ์ธ๋ฑ์Šค ์„ฑ๋Šฅ์„ ์œ ์ง€ํ•˜๋Š” ๋™์  ์ธ๋ฑ์‹ฑ ๊ธฐ์ˆ ๋กœ ๊ด€์‹ฌ์‚ฌ๊ฐ€ ์ด๋™ํ•จ. - **์ •์ฑ… ๋ณ€ํ™”:** Antigravity ํ”„๋กœ์ ํŠธ๋Š” 1,174๊ฐœ์˜ ๋ฌธ์„œ ์ค‘ ์œ ์‚ฌ ์ฃผ์ œ๋ฅผ ์ถ”์ฒœํ•˜๊ฑฐ๋‚˜ ์ค‘๋ณต์„ ๊ฒ€์‚ฌํ•  ๋•Œ, HNSW ์•Œ๊ณ ๋ฆฌ์ฆ˜ ๊ธฐ๋ฐ˜์˜ ๊ณ ์† ์ตœ๊ทผ์ ‘ ์ด์›ƒ ํƒ์ƒ‰ ๊ธฐ์ˆ ์„ ํ™œ์šฉํ•˜์—ฌ ์‹ค์‹œ๊ฐ„ ์ง€์‹ ์—ฐ๊ฒฐ์„ ๊ตฌํ˜„ํ•จ. ## ๐Ÿ”— ์ง€์‹ ์—ฐ๊ฒฐ (Graph) - [[Locality-Sensitive-Hashing|Locality-Sensitive-Hashing]], Vector-Database-Foundations, [[K-Nearest-Neighbors-K-NN|K-Nearest-Neighbors-K-NN]], Distance-Metrics-in-AI - **Raw Source:** 10_Wiki/Topics/AI/Nearest-Neighbor-Search.md