2nd/10_Wiki/Topics/AI_and_ML/Optical-Character-Recognition.md

id, title, category, status, canonical_id, aliases, duplicate_of, source_trust_level, confidence_score, verification_status, tags, raw_sources, last_reinforced, github_commit, tech_stack

id	title	category	status	canonical_id	aliases	duplicate_of	source_trust_level	confidence_score	verification_status	tags	raw_sources	last_reinforced	github_commit	tech_stack
wiki-2026-0508-optical-character-recognition	Optical Character Recognition	10_Wiki/Topics	verified	self	OCR Text Recognition Document AI	none	A	0.9	applied	ocr document-ai tesseract paddleocr donut vision-language		2026-05-10	pending	language framework python paddleocr/transformers

Optical Character Recognition

한 줄

이미지·스캔·PDF에서 텍스트를 추출하는 기술 — 전통 CRNN 파이프라인부터 modern Donut/TrOCR/Surya 및 VLM 직접 추출까지.

핵심

• Pipeline: detection (DBNet/CRAFT) → recognition (CRNN/Transformer) → post-process(NMS, layout).
• Engines:
  • Tesseract (오래됨, 다국어, 무료, 정밀도 낮음)
  • EasyOCR (PyTorch, 80+ 언어)
  • PaddleOCR (강력, 중국어/한국어 우수)
  • Surya (modern multilingual, layout)
  • TrOCR (HF, 단어/라인 인식)
  • Donut (OCR-free document understanding)
• VLM-OCR: GPT-5 Vision, Claude Sonnet 4.7, Qwen2.5-VL — 복잡 양식·표·손글씨에서 강함.
• Layout: LayoutLMv3, DocFormer, Nougat(논문).
• 평가: CER(Character Error Rate), WER, F1 on key fields.

💻 패턴

# 1. Tesseract — 빠른 baseline
# brew install tesseract tesseract-lang
import pytesseract
from PIL import Image

img = Image.open("invoice.png")
text = pytesseract.image_to_string(img, lang="eng+kor")
data = pytesseract.image_to_data(img, output_type=pytesseract.Output.DICT)
# data 안에 (text, conf, left, top, width, height) 포함

# 2. EasyOCR — Python-only 다국어
# pip install easyocr
import easyocr

reader = easyocr.Reader(["en", "ko"])
results = reader.readtext("receipt.jpg", detail=1)
for box, text, conf in results:
    print(f"{conf:.2f}: {text}")

# 3. PaddleOCR — 강력한 한·중·영
# pip install paddleocr paddlepaddle
from paddleocr import PaddleOCR

ocr = PaddleOCR(use_angle_cls=True, lang="korean", show_log=False)
res = ocr.ocr("doc.png", cls=True)
for line in res[0]:
    box, (txt, conf) = line
    print(txt, conf)

# 4. Surya — modern, layout + reading order
# pip install surya-ocr
from surya.ocr import run_ocr
from surya.model.detection.model import load_model as det_model, load_processor as det_proc
from surya.model.recognition.model import load_model as rec_model
from surya.model.recognition.processor import load_processor as rec_proc
from PIL import Image

img = Image.open("page.png")
preds = run_ocr([img], [["ko", "en"]],
                det_model(), det_proc(),
                rec_model(), rec_proc())
for line in preds[0].text_lines:
    print(line.text, line.confidence)

# 5. TrOCR (HuggingFace) — 라인 단위
from transformers import TrOCRProcessor, VisionEncoderDecoderModel
from PIL import Image

proc = TrOCRProcessor.from_pretrained("microsoft/trocr-large-printed")
model = VisionEncoderDecoderModel.from_pretrained("microsoft/trocr-large-printed")

img = Image.open("line.png").convert("RGB")
pix = proc(img, return_tensors="pt").pixel_values
ids = model.generate(pix)
print(proc.batch_decode(ids, skip_special_tokens=True)[0])

# 6. Donut — OCR-free document QA / parsing
from transformers import DonutProcessor, VisionEncoderDecoderModel
import torch

proc = DonutProcessor.from_pretrained("naver-clova-ix/donut-base-finetuned-cord-v2")
model = VisionEncoderDecoderModel.from_pretrained("naver-clova-ix/donut-base-finetuned-cord-v2")

prompt = "<s_cord-v2>"
ids = proc.tokenizer(prompt, add_special_tokens=False, return_tensors="pt").input_ids
pix = proc(Image.open("receipt.png").convert("RGB"), return_tensors="pt").pixel_values
out = model.generate(pix, decoder_input_ids=ids, max_length=512)
print(proc.token2json(proc.batch_decode(out)[0]))
# {"menu":[...], "total":...} 직접 JSON 출력

# 7. VLM 직접 OCR (Claude Vision)
import anthropic, base64

img_b64 = base64.b64encode(open("scan.png", "rb").read()).decode()
client = anthropic.Anthropic()
resp = client.messages.create(
    model="claude-sonnet-4-7",
    max_tokens=2048,
    messages=[{"role": "user", "content": [
        {"type": "image", "source": {"type": "base64",
            "media_type": "image/png", "data": img_b64}},
        {"type": "text", "text":
            "Extract all text. Output JSON with fields: title, date, line_items[{name, qty, price}], total."},
    ]}],
)
print(resp.content[0].text)

# 8. PDF → 텍스트 (pdfplumber + OCR fallback)
import pdfplumber, pytesseract
from pdf2image import convert_from_path

def pdf_to_text(path):
    out = []
    with pdfplumber.open(path) as pdf:
        for i, page in enumerate(pdf.pages):
            t = page.extract_text() or ""
            if len(t.strip()) < 20:  # scanned page → OCR
                img = convert_from_path(path, first_page=i+1, last_page=i+1)[0]
                t = pytesseract.image_to_string(img)
            out.append(t)
    return "\n\n".join(out)

결정 기준

상황	추천
빠른 prototype, 인쇄 영문	Tesseract
다국어 일반	PaddleOCR / EasyOCR
한국어 정밀	PaddleOCR(ko) / Surya
현대 다국어 + layout	Surya
라인 단위 정밀	TrOCR
영수증·송장·양식 → 구조 JSON	Donut / VLM
복잡 표·손글씨	Claude Sonnet / GPT-5 Vision
학술 PDF (수식)	Nougat
디지털 PDF	pdfplumber, OCR fallback

🔗 Graph

• Related: [[Document-AI]], , , , , ,

🤖 LLM 활용

• VLM은 OCR + reasoning 동시 수행 (영수증 → 항목별 카테고리 자동 분류).
• 전통 OCR + LLM 후처리: 오타·줄바꿈 normalize, 누락 필드 추론.

❌ 안티패턴

• 저화질 이미지를 그대로 입력 (전처리 필수: deskew, binarize, dpi≥300).
• Tesseract만 믿고 한국어 받침 깨진 채 배포.
• VLM에 큰 PDF를 한 번에 — chunk per page.
• confidence threshold 무시하고 raw text 사용.

🧪 검증

• Ground truth와 CER/WER 측정.
• Field-level F1 (date/total/total_tax 등 critical 필드).
• 다양한 폰트·해상도·회전 sample suite 유지.

🕓 Changelog

• 2026-05-08 Phase 1: 초안.
• 2026-05-10 Manual cleanup: 8 패턴, Surya/Donut/VLM 추가.