Superlinked SIE

Agent stacks need more than a chat model, and SIE serves the rest: Superlinked's Apache 2.0 inference engine hosts a pre-configured catalog of models for embeddings (BGE-M3, ColBERT, SPLADE sparse vectors), cross-encoder reranking, GLiNER-based entity extraction, document-to-markdown conversion of PDFs and Office files, Granite Guardian content safety, and light text generation with open LLMs. Everything sits behind OpenAI-compatible endpoints, /v1/embeddings and /v1/chat/completions among them, so existing clients migrate by changing a base URL, and models load on demand with LRU eviction to keep memory bounded. The same server scales from a laptop, installed with pip install sie-server, through Docker images for CPU and CUDA 12 GPUs, up to Kubernetes with Helm charts, KEDA autoscaling, a load-balancing gateway, Grafana dashboards, and Terraform modules for GKE, EKS, and AKS. GPUs are optional, with CPU and Apple Silicon MLX inference throughout, and a TypeScript SDK joins the Python client for application teams.