GOT-OCR

General OCR Theory model with unified end-to-end architecture for various OCR tasks.

Open SourceSelf HostedOffline CapableGPU Required (6GB+ VRAM)
0.0 (0)

About

GOT-OCR2.0 implements General OCR Theory, the idea that one unified end-to-end model can replace a pipeline of task-specific OCR systems. A vision encoder built on the Vary model feeds a Qwen-based language decoder, and the same weights read scene text, dense documents, mathematical formulas, tables, charts, and even sheet music. It supports plain text extraction, formatted output that preserves layout, fine-grained region OCR guided by bounding boxes, multi-page documents, and rendered HTML visualization of results. Inference runs through Hugging Face Transformers with batch support, and the community has ported it to ONNX, MNN, llama.cpp GGUF, and vLLM, with LoRA fine-tuning available via ms-swift and distributed training through DeepSpeed. The code is Apache 2.0 licensed while the training data carries CC-BY-NC 4.0 terms. The model passed one million downloads on Hugging Face within months of release and is frequently used for document parsing in RAG pipelines.

Should you use GOT-OCR?

Pick it when

Use GOT-OCR when one model must read scene text, dense pages, formulas, charts, and even sheet music, you have a GPU with around 6 GB of VRAM, and you want region-guided OCR or community GGUF, ONNX, and MNN ports.

Look elsewhere when

Skip it if licensing clarity matters: the code is Apache-2.0 but the training data carries CC-BY-NC 4.0 terms. For layout-aware PDF to Markdown with MIT weights, dots.ocr is the cleaner commercial pick.

Alternatives to GOT-OCR

  • dots.ocr

    MIT weights and layout boxes with categories, trading GOT's sheet music and scene-text breadth for document-focused structure.

  • DeepSeek-OCR

    MIT-licensed and built for high-throughput vLLM batching of PDF pages, while GOT has more community ports for small or CPU-bound deployments.

  • Nougat

    Narrower: tuned for English academic papers with Mathpix-compatible Markdown, and its weights are explicitly CC-BY-NC, a firmer restriction than GOT's training-data terms.

  • PaddleOCR

    CPU-friendly classical pipeline with layout and table modules under Apache-2.0, without the training-data license caveat.

Reviews (0)

Leave a Review

No reviews yet. Be the first to review!

Details

Price
Free
Platform
Local/Desktop
Difficulty
Intermediate (3/5)
License
Apache-2.0
Minimum VRAM
6 GB
Added
Apr 3, 2026

Tags