AI

Baidu Releases Unlimited-OCR Open-Source Model That Reads 40 Pages at Once

Baidu's open-source Unlimited-OCR model processes 40-page documents in a single pass with 93% accuracy, outperforming commercial rivals.

By Tim Editorial

Baidu Releases Unlimited-OCR Open-Source Model That Reads 40 Pages at Once
images.indianexpress.com

Baidu has released Unlimited OCR, an open source optical character recognition (OCR) model capable of processing documents up to 40 pages in a single inference. The model, which has 3 billion parameters but activates only 500 million during inference, runs entirely locally on the user's device, according to Baidu's official GitHub repository. Unlimited OCR is designed to address a key limitation of traditional OCR systems that process documents page by page. When pages are split, tables spanning two pages are often broken, reading order is lost, and cross page context is disconnected. By processing the entire document at once with a 32K context window, Unlimited OCR preserves text, formulas, tables, and reading order across pages.

According to a post on X by @VaibhavSisinty, the model achieves 93% accuracy on standard benchmarks, outperforming the baseline by 6 percentage points. The error rate remains below 0.11 even after 40 pages. The model also supports multiple languages natively and outputs clean, structured Markdown. On Hugging Face, Unlimited OCR has been downloaded 2.12 million times in the past month, per data from @VaibhavSisinty. Meanwhile, Baidu's GitHub repository for the project has garnered 14,600 stars, indicating significant interest from the developer community in this open source OCR model. A comparison with commercial OCR services highlights a clear cost advantage. Amazon Textract, Google Cloud Vision, and Azure Document Intelligence all charge per page.

Unlimited OCR, in contrast, runs locally and is free, making it an attractive alternative for companies or individuals processing large volumes of documents. Baidu's GitHub repository for Unlimited OCR describes the project as "Unlimited OCR Works: Welcome the Era of One shot Long horizon Parsing." This phrase emphasizes the model's ability to parse long documents in a single step, a departure from traditional sequential methods. The model is licensed under MIT, meaning users can freely use, modify, and distribute it. This license facilitates adoption by developers and companies who want to integrate OCR into their applications without worrying about licensing fees. From a technical standpoint, Unlimited OCR's ability to process 40 page documents in a single read is supported by a 32K context window.

This allows the model to maintain cross page context, something difficult for traditional OCR models that process pages one by one. While claims about parameters and accuracy originate from the X account @VaibhavSisinty, Baidu's official GitHub repository confirms the model's existence and its capability for long document parsing. However, specific details such as parameter count and accuracy scores have not been independently confirmed by Baidu through an official press release. Unlimited OCR offers significant potential for various applications, including document digitization, archiving, contract analysis, and form processing. With its ability to run locally, the model also provides data privacy advantages, as documents do not need to be sent to external servers for processing. Looking ahead, adoption of Unlimited OCR will depend on ease of use, documentation, and community support.

With an MIT license and strong early popularity on Hugging Face and GitHub, the model has a solid foundation for growth. However, independent validation of performance claims is still needed to reassure corporate users. The release of Unlimited OCR comes at a time when demand for efficient, privacy preserving OCR solutions is growing. Enterprises handling sensitive documents, such as legal firms and financial institutions, may find the local processing capability particularly appealing. The model's ability to handle multi page documents in a single pass could also streamline workflows in industries like insurance, where lengthy forms and contracts are common. Baidu's move to open source the model under a permissive license aligns with a broader trend among Chinese tech companies to contribute to the global open source community.

This strategy can help build goodwill, attract talent, and drive adoption of Baidu's ecosystem. However, it also raises questions about how Baidu plans to monetize the technology, given that the model is free and runs locally. Despite the enthusiasm, some experts caution that the 93% accuracy figure may not hold across all document types and languages. The benchmark results cited by @VaibhavSisinty have not been peer reviewed or replicated by independent researchers. Additionally, the model's performance on complex layouts, such as those with dense tables or mixed scripts, remains to be thoroughly evaluated. In summary, Unlimited OCR represents a notable advancement in open source OCR technology, offering a free, local, and high accuracy alternative to commercial services.

Its ability to process entire documents in one go addresses a real pain point for many users. As the community tests and refines the model, its true capabilities and limitations will become clearer. For now, it stands as a promising tool for developers and organizations seeking to digitize documents efficiently and securely.

Sources and references