Indexify

Indexify is an open source data extraction and indexing engine from Tensorlake, built for teams assembling retrieval-augmented generation systems. It ingests unstructured content such as documents, images, and audio and runs extraction pipelines over it, producing structured data and embeddings that downstream applications can query, with a focus on keeping indexes updated continuously as new content arrives rather than through periodic batch jobs. The engine is designed to scale out on Kubernetes for production workloads, placing it in the infrastructure layer between raw data sources and the vector databases or LLM applications that consume the results. Released under the Apache 2.0 license, it targets engineers who need ongoing ingestion and extraction rather than one-off preprocessing scripts. Tensorlake, the company behind the project, has since shifted its public focus toward sandbox infrastructure for AI agents, and the original Indexify repository is no longer available at its previous address.