---
id: wiki-2026-0508-relu-activation-functions
title: ReLU Activation Functions
category: 10_Wiki/Topics
status: duplicate
canonical_id: leaky-relu-and-activations
duplicate_of: "[[Leaky-ReLU-and-Activations]]"
aliases: []
source_trust_level: A
confidence_score: 0.9
verification_status: redirected
tags: [duplicate, relu, activation]
last_reinforced: 2026-05-10
github_commit: pending
---

# ReLU Activation Functions

> **이 문서는 [[Leaky-ReLU-and-Activations]] 의 중복본입니다.** Canonical 문서로 redirect.

## 핵심 요약
- ReLU = `max(0, x)` — 매 dying-ReLU 의 issue 의 Leaky/PReLU/GELU 의 mitigate.
- 2026 transformer 의 GELU/SwiGLU 의 dominant; CNN 의 still ReLU.

## 🔗 Graph
- 부모: [[Leaky-ReLU-and-Activations]] (canonical)

## 🕓 변경 이력
| 날짜 | 변경 |
|---|---|
| 2026-05-08 | Phase 1 |
| 2026-05-10 | 중복 처리 — canonical 문서로 redirect |