2nd/10_Wiki/Topics/AI_and_ML/ReLU-Activation-Functions.md

id, title, category, status, canonical_id, duplicate_of, aliases, source_trust_level, confidence_score, verification_status, tags, last_reinforced, github_commit

id	title	category	status	canonical_id	duplicate_of	aliases	source_trust_level	confidence_score	verification_status	tags	last_reinforced	github_commit
wiki-2026-0508-relu-activation-functions	ReLU Activation Functions	10_Wiki/Topics	duplicate	leaky-relu-and-activations	Leaky-ReLU-and-Activations		A	0.9	redirected	duplicate relu activation	2026-05-10	pending

ReLU Activation Functions

이 문서는 Leaky-ReLU-and-Activations 의 중복본입니다. Canonical 문서로 redirect.

핵심 요약

• ReLU = max(0, x) — 매 dying-ReLU 의 issue 의 Leaky/PReLU/GELU 의 mitigate.
• 2026 transformer 의 GELU/SwiGLU 의 dominant; CNN 의 still ReLU.

🔗 Graph

• 부모: Leaky-ReLU-and-Activations (canonical)

🕓 변경 이력

날짜	변경
2026-05-08	Phase 1
2026-05-10	중복 처리 — canonical 문서로 redirect